-- Logs begin at Wed 2022-08-24 08:00:03 UTC, end at Wed 2022-08-24 09:18:09 UTC. -- Aug 24 08:46:37.664871 dv-cinder-852210-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 08:46:37.676800 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 08:46:37.678846 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 08:46:37 2022] *** Aug 24 08:46:37.678846 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 08:46:37.678846 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 08:46:37.678846 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: nodename: dv-cinder-852210-4-iscsi Aug 24 08:46:37.678846 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: machine: x86_64 Aug 24 08:46:37.678846 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: clock source: unix Aug 24 08:46:37.678846 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: pcre jit disabled Aug 24 08:46:37.678846 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: detected number of CPU cores: 4 Aug 24 08:46:37.678846 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: current working directory: / Aug 24 08:46:37.678846 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: detected binary path: /usr/bin/uwsgi-core Aug 24 08:46:37.679559 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: your processes number limit is 47680 Aug 24 08:46:37.679559 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: your memory page size is 4096 bytes Aug 24 08:46:37.679559 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: detected max file descriptor number: 2048 Aug 24 08:46:37.679559 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: lock engine: pthread robust mutexes Aug 24 08:46:37.679559 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: thunder lock: enabled Aug 24 08:46:37.679559 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 08:46:37.679559 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 08:46:37.719294 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: Python main interpreter initialized at 0x56386826e9c0 Aug 24 08:46:37.719294 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: python threads support enabled Aug 24 08:46:37.719294 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: your server socket listen backlog is limited to 100 connections Aug 24 08:46:37.719294 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: your mercy for graceful operations on workers is 90 seconds Aug 24 08:46:37.719703 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 08:46:37.719781 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: *** Operational MODE: preforking *** Aug 24 08:46:37.719995 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: *** uWSGI is running in multiple interpreter mode *** Aug 24 08:46:37.719995 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: spawned uWSGI master process (pid: 117916) Aug 24 08:46:37.720298 dv-cinder-852210-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 08:46:37.722627 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: spawned uWSGI worker 1 (pid: 117937, cores: 1) Aug 24 08:46:37.722627 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: spawned uWSGI worker 2 (pid: 117938, cores: 1) Aug 24 08:46:37.722627 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 08:46:38.388795 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 08:46:38.408066 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 08:46:39.469010 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:46:39.469010 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: from cryptography.utils import int_from_bytes Aug 24 08:46:39.469575 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:46:39.469575 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: from cryptography.utils import int_from_bytes Aug 24 08:46:39.488716 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:46:39.488716 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: from cryptography.utils import int_from_bytes Aug 24 08:46:39.489281 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:46:39.489281 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: from cryptography.utils import int_from_bytes Aug 24 08:46:41.957727 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 08:46:41.958295 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 08:46:41.958484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 08:46:41.958841 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 08:46:41.959094 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 08:46:41.959478 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.959796 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.960112 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.960427 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.960792 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.961102 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.961417 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.961729 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.962049 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.962305 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.962626 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.962941 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-4-iscsi {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.963258 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.963562 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.963868 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.964182 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.964478 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.964821 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.965120 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.965618 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.966059 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.966395 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.966704 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.967036 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.967349 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.967520 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 08:46:41.967933 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.968007 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 08:46:41.968080 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.968253 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.968395 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 08:46:41.968702 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.968794 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 08:46:41.968892 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.969074 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 08:46:41.969319 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-4-iscsi {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.969439 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.969617 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.969719 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.969925 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.970026 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.970230 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.970352 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.970640 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.970736 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.970945 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.971037 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.971250 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.971343 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.971566 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.971664 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.971881 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.971981 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.972184 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.972282 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.972504 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.972612 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.972848 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.972959 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-4-iscsi {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.973161 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.973249 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.973471 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.973556 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.973766 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.973865 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.974069 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.974157 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.974373 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.974467 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.974687 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.974784 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.974990 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.975088 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.975289 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.975501 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.975624 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.975816 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.975903 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.976122 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.976226 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.976442 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.976528 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.976790 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.976898 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.977039 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.977170 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.977287 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.977484 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.977622 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.977803 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.977913 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.978116 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.978209 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.978442 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.978540 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.978752 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.978950 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.979059 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.979158 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-4-iscsi {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.979358 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.979542 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.979663 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.979759 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.979965 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.980060 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.980264 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.980458 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.980599 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.980798 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.980896 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.981112 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.981220 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.981434 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.981529 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.982278 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.982374 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.982741 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.982857 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.982938 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.983014 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.983219 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.983314 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.983553 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.983658 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.983867 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.983974 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.984173 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.984277 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.984491 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.984681 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.984821 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.984915 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.985146 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.985241 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.985456 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.985550 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.985758 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.985860 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.986013 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.986110 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.986336 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.986429 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.986659 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.986763 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.986917 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.987018 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.987214 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.987364 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.987516 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.987612 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.987794 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.987895 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.988120 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.988232 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.988421 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.988510 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.988748 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.988845 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.989045 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.989160 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.989346 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.989478 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.989742 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.989891 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.990030 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.990117 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.990390 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.990497 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.990635 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.990729 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.990936 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.991021 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.991238 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.991331 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.991539 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.991627 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.991839 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.991924 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.992151 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.992292 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.992467 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.992582 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.992795 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.992914 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.993096 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.993195 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.993397 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.993483 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.993697 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.993791 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.994010 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.994103 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.994312 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.994445 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.994614 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.994771 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.994929 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.995094 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.995232 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.995404 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.995531 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.995715 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.995845 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.996061 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.996148 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.996383 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.996477 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.996742 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.996830 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.997044 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.997130 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.997295 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.997413 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.998147 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.998236 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.998457 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.998544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.998777 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.998863 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.999086 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.999181 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.999402 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.999488 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.999700 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:41.999785 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.000000 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.000096 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.000299 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.000384 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.000618 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.000709 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.000918 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.001019 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.001223 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.001356 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.001531 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.001621 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.001832 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.001926 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.002133 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.002228 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.002432 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.002517 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.002737 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.002832 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.003060 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.003200 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.003382 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.003484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.003691 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.003779 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.003997 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.004083 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.004303 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.004398 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.004632 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.004720 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.004956 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.005054 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.005263 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.005350 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.005575 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.005662 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.005895 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.005982 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.006203 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.006295 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.006510 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.006605 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.006814 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.006907 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.007132 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.007218 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.007444 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.007531 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.007764 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.007850 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.008067 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.008208 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.008376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.008461 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.008720 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.008808 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.009031 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.009177 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.009347 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.009443 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.009655 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.009742 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.009961 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.010092 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.010267 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.010353 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.010574 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.010667 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.010880 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.010975 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.011227 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.011316 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.011535 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.011631 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.011854 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.011940 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.012165 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.012250 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.012474 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.012638 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.012809 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.012922 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.013147 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.013281 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.013470 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:42.013559 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.013776 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.013870 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.014091 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.014177 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.014402 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.014490 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.014711 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.014798 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.015019 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.015105 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.015327 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.015414 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.015634 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.015722 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.015966 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.016051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.016278 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.016372 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.016616 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.016708 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.017197 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.017290 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.017512 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.017610 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.017819 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.017918 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.018126 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.018251 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.018436 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.018536 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.018740 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.018851 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.019043 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.019173 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.019344 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.019500 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.019651 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.019823 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.019952 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.020136 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.020268 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.020459 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.020617 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.020816 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.020925 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.021142 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.021254 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.021458 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.021591 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.021802 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.021895 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.022147 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.022243 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.022452 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.022538 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.022756 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.022849 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.023063 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.023160 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.023369 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.023463 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.023671 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.023766 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.023992 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.024089 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.024300 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.024386 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.024630 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.024720 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.024952 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.025048 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.025255 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.025348 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.025556 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.025642 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.025866 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.025953 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.026173 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.026259 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.026480 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.026576 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.026785 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.026881 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.027099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.027195 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.027418 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.027512 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.027728 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.027823 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.028034 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.028128 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.028369 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.028499 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.028744 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.028841 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.029079 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.029174 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.029407 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.029508 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.029718 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.029812 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.030028 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.030128 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.030332 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.030513 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.030639 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.030727 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.030940 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.031033 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.031240 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.031336 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.031543 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.031672 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.031848 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.031934 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.032148 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.032244 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.032449 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.032570 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.032774 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.032863 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.033075 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.033171 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.033375 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.033518 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.033690 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.033778 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.033999 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.034091 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.034297 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.034383 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.034599 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.034684 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.034900 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.034987 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.035238 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.035324 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.035540 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.035628 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.035862 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.035948 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.036171 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.036256 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.036478 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.036606 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.036820 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.036907 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.037134 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.037220 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.037442 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.037539 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.037746 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.037839 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.038054 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.038140 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.038363 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.038518 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.038670 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.038758 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.038980 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.039073 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.039286 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.039385 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.039602 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.039689 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.039908 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.039994 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.040227 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.040330 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.040554 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.040654 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.040873 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.040959 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.041177 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.041265 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.041487 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.041586 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.041821 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.041929 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.042126 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.042214 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.042436 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.042524 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.042748 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.042834 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.043055 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.043142 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.043360 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.043455 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.043665 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.043762 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.043969 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.044062 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.044815 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.044910 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.045130 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.045231 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.045450 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.045540 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.045758 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.045845 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.046075 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.046171 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.046383 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.046470 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.046700 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.046787 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.047049 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.047150 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.047395 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.047485 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.047723 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.047815 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.048034 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.048121 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.048358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.048443 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.048698 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.048788 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.049003 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.049091 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.049312 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.049405 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.049626 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.049710 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.049931 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.050016 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.050240 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.050334 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.050553 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.050664 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.050857 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.050956 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.051156 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.051243 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.051464 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.051567 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.051775 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.051911 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.052080 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.052168 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.052387 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.052483 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.052713 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.052802 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.053023 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.053111 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.053328 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.053428 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.053629 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.053716 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.053929 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.054016 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.054233 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.054328 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.054549 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.054644 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.054855 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.054949 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.055168 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.055263 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.055485 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.055580 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.055787 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.055874 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.056087 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.056174 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.056405 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.056489 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.056733 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.056842 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.057036 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.057125 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.057336 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.057422 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.057641 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.057735 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.057974 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.058060 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.058281 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.058375 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.058586 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.058681 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.058923 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.059038 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.059215 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.059305 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.059521 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.059685 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.060438 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.060597 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.060794 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.060883 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.061105 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.061205 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.061422 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.061509 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.061734 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.061828 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.062042 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.062137 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.062347 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.062432 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.062656 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.062746 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.062964 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.063059 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.063276 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.063373 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.063592 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.063678 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.063901 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.063991 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.064205 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.064291 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.064509 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.064637 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.064841 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.064930 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.065149 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.065246 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.065463 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.065549 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.065809 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.066034 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.066121 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.066364 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.066458 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.066676 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.066771 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.066994 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.067080 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.067311 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.067405 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.067627 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.067713 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.067949 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.068037 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.068260 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.068345 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.068619 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.068727 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.068932 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.069053 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.069238 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.069315 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.069555 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.069683 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.069849 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.069933 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.070156 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.070250 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.070461 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.070560 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.070763 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.070905 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.071065 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.071153 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.071372 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.071467 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.071674 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.071760 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.071975 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.072061 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.072277 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.072388 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.072598 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.072678 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.072912 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.073045 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.073213 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.074431 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.074522 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.074592 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.074659 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.074724 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.074800 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.074869 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.074935 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.074935 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.075118 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.075259 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.075552 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.075635 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.075895 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.075982 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.076220 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.076307 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.076554 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.076658 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.076865 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.076961 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.077179 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.077279 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.077479 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.077566 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.077804 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.078065 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.078160 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.078391 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.078478 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.078690 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.078778 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.078993 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.079079 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.079295 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.079382 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.079594 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.079681 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.079899 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.080036 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.080203 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.080372 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.080507 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.080751 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.080856 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.081065 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.081156 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.081379 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.081467 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.081689 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.081776 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.081996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.082094 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.082303 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.082389 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.082602 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.082688 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.082901 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.083000 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.083205 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.083290 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.083507 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.083591 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.083807 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.083908 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.084109 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.084199 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.084407 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.084493 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.084734 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.084902 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.085035 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.085129 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.085334 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.085434 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.085634 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.085730 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.085939 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.086051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.086242 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.086336 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.086541 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.086677 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.086858 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.086945 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.087158 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.087244 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.087455 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.087543 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.087760 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.087860 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.088063 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.088149 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.088360 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.088447 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.088681 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.088785 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.088987 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.089133 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.089304 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.089392 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.089614 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.089700 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.089915 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.090010 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.090218 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.090305 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.090515 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.090601 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.090814 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.090914 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.091137 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.091227 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.091444 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.091542 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.091737 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.091835 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.092035 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.092122 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.092331 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.092417 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.092651 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.092754 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.092950 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.093037 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.093267 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.093356 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.093570 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.093664 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.093868 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.093955 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.094167 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.094253 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.094464 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.094552 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.094787 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.094881 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.095085 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.095178 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.095393 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.095483 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.095703 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.095789 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.096009 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.096108 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.096321 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.096408 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.096648 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.096736 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.096957 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.097066 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.097266 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.097353 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.097570 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.097658 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.097880 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.097983 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.098184 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.098270 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.098491 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.098578 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.098789 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.098889 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.099086 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.099230 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.099402 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.099489 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.099708 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.099804 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.100011 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.100152 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.100319 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.100406 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.100656 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.100746 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.100964 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.101062 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.101261 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.101350 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.101567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.101668 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.101872 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.101960 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.102175 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.102270 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.102477 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.102572 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.102778 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.102873 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.103082 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.103175 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.103385 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.103488 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.103692 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.103786 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.103995 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.104092 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.104299 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.104389 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.104625 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.104714 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.104931 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.105032 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.105234 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.105321 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.105529 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.105615 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.105845 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.105940 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.106148 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.106233 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.106445 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.106529 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.107261 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.107364 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.107557 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.107643 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.107861 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.107948 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.108165 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.108252 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.108560 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.108649 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.108913 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.109005 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.109218 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.109351 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.109520 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.109607 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.109824 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.109923 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.110127 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.110214 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.110428 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.110514 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.110735 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.110821 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.111035 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.111123 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.111352 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.111437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.111659 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.111754 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.111965 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.112058 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.112286 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.112381 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.112620 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.112730 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.112920 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.113014 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.113227 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.113324 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.113545 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.113712 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.113845 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.113939 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.114145 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.114233 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.114445 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.114550 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.114757 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.114844 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.115056 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.115142 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.115372 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.115460 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.115749 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.115842 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.116074 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.116161 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.116372 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.116461 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.116708 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.116796 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.117023 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.117110 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.117334 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.117432 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.117642 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.117729 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.117952 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.118046 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.118262 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.118349 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.118569 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.118654 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.118879 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.118973 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.119184 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.119271 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.119487 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.119577 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.119806 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.119910 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.120112 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.120199 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.120421 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.120516 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.120743 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.120847 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.121060 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.121201 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.121376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.121516 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.121682 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.121830 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.121996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.122135 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.122945 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.123040 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.123266 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.123355 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.123573 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.123660 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.123893 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.123989 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.124214 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.124302 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.124518 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.124673 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.124841 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.124986 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.125146 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.125298 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.125446 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.125610 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.125745 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.125999 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.126100 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.126308 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.126409 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.126621 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.126709 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.126938 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.127023 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.127240 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.127335 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.127540 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.127625 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.127839 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.127937 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.128158 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.128245 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.128459 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.128672 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.128804 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.128891 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.129115 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.129210 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.129434 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.129528 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.129752 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.129840 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.130054 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.130217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.130374 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.130529 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.130682 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.130840 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.130986 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.131166 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.131287 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.131488 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.131573 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.131863 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.131962 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.132176 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.132264 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.132492 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.132597 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.132829 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.132925 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.133155 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.133241 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.133460 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.133546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.133778 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.133864 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.134093 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.134180 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.134401 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.134488 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.134714 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.134800 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.135035 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.135122 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.135336 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.135430 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.135637 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.135725 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.135943 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.136061 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.136245 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.136386 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.136641 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.136745 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.136895 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.137034 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.137200 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.137387 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.137503 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.137693 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.137805 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.138025 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.138135 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.138339 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.138453 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.138646 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.138753 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.138951 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.139071 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.139277 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.139372 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.139584 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.139670 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.139897 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.139992 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.140208 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.140295 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.140518 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.140623 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.140845 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.140951 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.141157 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.141245 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.141469 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.141554 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.141771 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.142130 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.142356 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.142443 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.142668 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.142761 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.142982 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.143070 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.143290 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.143377 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.143601 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.143687 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.143910 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.143998 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.144219 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.144306 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.144522 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.144685 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.144850 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.144937 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.145156 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.145242 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.145468 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.145557 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.145883 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.146002 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.146209 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.146327 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.146545 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.146647 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.146879 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.146966 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.147192 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.147281 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.147528 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.147623 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.147836 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.147922 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.148169 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.148254 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.148489 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.148605 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.148866 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.148959 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.149174 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.149258 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.149485 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.149578 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.149792 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.149889 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.150100 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.150186 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.150428 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.150516 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.150735 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.150821 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.151044 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.151137 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.151348 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.151442 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.151655 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.151742 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.151961 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.152047 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.152289 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.152384 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.152613 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.152704 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.152929 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.153031 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.153237 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.153371 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.153560 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.154150 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.154384 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.154518 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.154695 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.154837 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.155002 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.155089 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.155310 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.155406 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.155617 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.155717 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.155923 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.156048 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.156232 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.156320 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.156557 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.156646 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.156885 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.156972 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.157203 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.157290 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.157522 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.157608 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.157829 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.157922 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.158139 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.158228 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.158451 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.158544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.158803 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.158951 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.159076 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.159269 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.159394 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.159601 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.159721 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.159926 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.160247 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.160332 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.160585 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.160675 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.160929 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.161033 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.161252 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.161370 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.161567 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.161685 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.161882 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.162049 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.162197 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.162284 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.162511 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.162600 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.162824 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.162949 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.163272 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.163373 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.163493 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.163581 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.163799 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.163887 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.164114 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.164208 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.164420 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.164507 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.164809 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.164974 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.165130 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.165319 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.165447 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.165635 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.165765 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.165959 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.166170 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.166280 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.166469 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.166594 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.166786 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.166882 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.167095 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.167203 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.167432 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.167523 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.167750 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.167837 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.168067 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.168163 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.168380 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.168477 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.168703 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.168791 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.169005 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.169091 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.169876 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.169973 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.170192 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.170278 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.170506 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.170602 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.170815 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.170903 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.171117 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.171203 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.171439 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.171535 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.171744 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.171830 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.172046 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.172141 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.172347 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.172442 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.172683 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.172827 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.172991 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.173079 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.173292 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.173584 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.173672 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.173883 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.173969 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.174190 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.174276 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.174489 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.174582 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.174795 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.174889 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.175094 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.175202 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.175401 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.175487 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.175699 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.175785 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.176003 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.176098 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.176302 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.176388 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.176640 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.176730 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.176945 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.177052 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.177300 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.177389 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.177612 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.177698 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.177919 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.178014 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.178227 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.178314 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.178532 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.178617 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.178836 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.178924 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.179180 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.179379 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.179492 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.179734 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.180022 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.180110 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.180353 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.180440 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.180693 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.180783 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.181024 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.181113 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.181354 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.181442 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.181660 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.181754 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.181963 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.182051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.182265 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.182359 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.182585 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.182680 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.182892 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.182979 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.183203 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.183314 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.183510 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.183608 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.183816 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.183952 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.184120 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.184208 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.184425 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.184553 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.184766 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.184881 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.185094 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.185182 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.185401 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.185489 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.185705 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.185792 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.186011 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.186105 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.186314 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.186409 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.186618 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.186748 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.186921 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.187009 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.187225 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.187320 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.187533 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.187628 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.187838 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.187925 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.188153 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.188241 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.188460 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.188600 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.188796 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.188935 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.189108 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.189212 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.189410 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.189505 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.189714 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.189812 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.190021 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.190109 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.190323 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.190417 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.190645 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.190742 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.190949 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.191042 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.191250 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.191336 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.191608 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.191693 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.191922 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.192000 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.192249 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.192326 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.192579 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.192663 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.192892 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.192968 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.193214 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.193291 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.193533 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.193611 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.193839 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.194100 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.194192 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.194445 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.194531 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.194768 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.194851 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.195100 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.195183 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.195423 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.195508 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.195731 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.195807 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.196033 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.196119 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.196335 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.196417 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.196659 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.196753 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.196965 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.197051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.197280 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.197356 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.197583 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.197666 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.197883 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.197979 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.198180 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.198267 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.198483 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.198570 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.198782 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.198872 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.199082 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.199178 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.199380 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.199476 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.199678 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.199766 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.199980 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.200109 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.200280 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.200399 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.200629 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.200766 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.200934 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.201050 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.201235 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.201360 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.201534 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.201674 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.201859 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.202011 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.202153 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.202306 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.202449 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.202592 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.202744 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.202902 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.203018 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.203217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.203333 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.203531 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.203654 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.203832 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.203976 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.204225 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.204372 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.204515 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.204709 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.204870 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.205029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.205120 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.205200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.205383 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.205480 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.205683 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.205817 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.205998 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.206133 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.206313 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.206444 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.206621 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.206765 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.206923 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.207076 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.207252 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.207425 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.207558 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.207797 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.207891 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.208068 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.208158 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.208391 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.208493 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.208729 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.208828 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.209051 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.209146 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.209376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.209473 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.209701 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.209790 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.210005 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.210092 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.210326 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.210413 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.210635 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.210723 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.210942 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.211028 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.211252 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.211345 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.211559 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.211655 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.211883 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.211979 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.212190 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.212279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.212494 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.212599 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.212829 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.212937 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.213136 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.213223 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.213438 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.213531 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.213741 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.213836 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.214045 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.214140 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.214354 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.214453 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.214654 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.214759 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.214960 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.215055 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.215266 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.215354 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.215570 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.215670 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.215876 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.215972 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.216729 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.216891 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.217052 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.217219 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.217395 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.217531 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.217703 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.217842 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.218041 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.218151 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.218367 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.218454 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.218677 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.218772 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.218985 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.219082 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.219287 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.219400 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.219528 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 08:46:42.219720 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.220044 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.220358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.220715 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.221028 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.221352 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.221681 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.221997 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.222309 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.222644 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.222956 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.223297 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.223610 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.223923 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.224232 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.224584 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.224916 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.225244 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.225552 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.225881 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.226202 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.226525 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.226846 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.227157 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.227488 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.227801 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.228115 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.228427 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.228763 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.229076 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.229390 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.229701 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.230011 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.230354 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.230671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.231001 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.231326 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.231644 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.232514 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.232868 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.233221 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.233537 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.233884 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.234257 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.234576 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.234887 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.235197 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:42.235443 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 08:46:42.373643 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO dbcounter [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Registered counter for database nova_api Aug 24 08:46:42.390859 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] Registered counter for database nova_api Aug 24 08:46:42.395825 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_db.sqlalchemy.engines [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:42.402586 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writer thread running {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:42.411800 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:42.418462 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:42.458547 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.context [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7d12875-14d7-416e-86d0-e7719092bb5f(cell1) {{(pid=117937) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 08:46:42.462348 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:46:42.462813 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:46:42.464364 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:46:42.465113 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:46:42.465551 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:46:42.468037 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:46:42.469997 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO dbcounter [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Registered counter for database nova_cell0 Aug 24 08:46:42.475372 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.context [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7d12875-14d7-416e-86d0-e7719092bb5f(cell1) {{(pid=117938) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 08:46:42.475501 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO dbcounter [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Registered counter for database nova_cell1 Aug 24 08:46:42.479336 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:46:42.480126 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:46:42.481547 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:46:42.482895 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:46:42.483511 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:46:42.483631 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_db.sqlalchemy.engines [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:42.485969 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:46:42.486175 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_db.sqlalchemy.engines [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:42.488192 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] Registered counter for database nova_cell0 Aug 24 08:46:42.490598 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writer thread running {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:42.493992 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] Registered counter for database nova_cell1 Aug 24 08:46:42.501330 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:42.503509 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:42.508782 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:42.514197 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:42.627683 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writer thread running {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:42.637544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO dbcounter [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Registered counter for database nova_cell0 Aug 24 08:46:42.647317 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_db.sqlalchemy.engines [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:42.651784 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writer thread running {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:42.657908 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] Registered counter for database nova_cell0 Aug 24 08:46:42.667367 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:42.671817 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:43.053833 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: WARNING keystonemiddleware.auth_token [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:46:43.061741 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: WARNING keystonemiddleware.auth_token [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:46:43.092819 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:46:43.100046 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:46:43.401919 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: WARNING keystonemiddleware.auth_token [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:46:43.407954 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: WARNING keystonemiddleware.auth_token [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:46:43.413606 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56386826e9c0 pid: 117937 (default app) Aug 24 08:46:43.415680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:46:43.416873 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 Aug 24 08:46:43.417286 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Wed Aug 24 08:46:43 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:46:43.443728 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:46:43.449730 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-b7a79008-2ad3-48fd-bcc2-b9bbfd6367c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:46:43.455028 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56386826e9c0 pid: 117938 (default app) Aug 24 08:48:08.191164 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:08.192100 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Aug 24 08:48:08.197495 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:48:08 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:08.220745 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:08.223884 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:08.225167 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:08.226445 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:09.282160 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-21160640-eb79-4349-a259-38f629572c5e admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:09.317619 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-21160640-eb79-4349-a259-38f629572c5e admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.110133 Aug 24 08:48:09.318181 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 1/3] 10.222.0.55 () {60 vars in 1292 bytes} [Wed Aug 24 08:48:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:48:11.899272 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:11.900277 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-56f71e32-2b35-4ef0-9743-a0963830a09b None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 08:48:11.900869 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 3/4] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:48:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:12.356781 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a31c0e9a-a03b-4a88-88cc-ef47d8ab7c2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:12.378430 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:48:12.378430 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: warnings.warn(msg) Aug 24 08:48:12.483941 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a31c0e9a-a03b-4a88-88cc-ef47d8ab7c2a admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.575814 Aug 24 08:48:12.484822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 2/5] 10.222.0.55 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:12.499051 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:12.499893 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:12.500902 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:12.501621 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:12.705453 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f017c23a-281d-46cd-a655-1af2bd9b16d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:12.709845 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:48:12.709845 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: warnings.warn(msg) Aug 24 08:48:12.822142 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f017c23a-281d-46cd-a655-1af2bd9b16d7 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.328742 Aug 24 08:48:12.822898 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 4/6] 10.222.0.55 () {64 vars in 1336 bytes} [Wed Aug 24 08:48:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:48:15.212790 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a31c0e9a-a03b-4a88-88cc-ef47d8ab7c2a admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:15.214369 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a31c0e9a-a03b-4a88-88cc-ef47d8ab7c2a admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Aug 24 08:48:15.214787 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 3/7] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:48:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:15.958166 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-8d5ce935-0f86-469b-955c-f4e2250c9516 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "disk": 5}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:15.978028 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:48:15.978028 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: warnings.warn(msg) Aug 24 08:48:16.101098 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-8d5ce935-0f86-469b-955c-f4e2250c9516 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.879572 Aug 24 08:48:16.101913 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 5/8] 10.222.0.55 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 08:48:16.114638 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d6f03c03-b709-40af-9da4-ca825d8cf784 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:16.117477 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:48:16.117477 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: warnings.warn(msg) Aug 24 08:48:16.209827 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d6f03c03-b709-40af-9da4-ca825d8cf784 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098915 Aug 24 08:48:16.210907 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 4/9] 10.222.0.55 () {64 vars in 1336 bytes} [Wed Aug 24 08:48:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:48:18.622905 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-8d5ce935-0f86-469b-955c-f4e2250c9516 admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:18.623927 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-8d5ce935-0f86-469b-955c-f4e2250c9516 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 24 08:48:18.624335 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:48:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:19.049191 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fac3634a-2998-4893-a67f-1bcd6e743055 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:19.134220 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fac3634a-2998-4893-a67f-1bcd6e743055 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.502628 Aug 24 08:48:19.134779 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 5/11] 10.222.0.55 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:19.147269 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1ce870bd-78e3-4d71-a8c7-8886a558f5f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:19.287531 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1ce870bd-78e3-4d71-a8c7-8886a558f5f5 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.144123 Aug 24 08:48:19.288139 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 7/12] 10.222.0.55 () {64 vars in 1336 bytes} [Wed Aug 24 08:48:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:48:21.788086 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fac3634a-2998-4893-a67f-1bcd6e743055 admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:21.789051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fac3634a-2998-4893-a67f-1bcd6e743055 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 24 08:48:21.789463 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 6/13] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:48:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:22.238174 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-868582e7-d7be-4a53-b1bf-f83910462fcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "swap": 0, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:22.329699 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-868582e7-d7be-4a53-b1bf-f83910462fcd admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.533059 Aug 24 08:48:22.330413 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 8/14] 10.222.0.55 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 08:48:22.345644 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8e611083-1500-484c-ac51-ba068c8db7a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:22.442727 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8e611083-1500-484c-ac51-ba068c8db7a0 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100645 Aug 24 08:48:22.443602 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 7/15] 10.222.0.55 () {64 vars in 1336 bytes} [Wed Aug 24 08:48:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:48:25.091497 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-868582e7-d7be-4a53-b1bf-f83910462fcd admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:25.092590 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-868582e7-d7be-4a53-b1bf-f83910462fcd admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 24 08:48:25.093029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 9/16] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:48:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:48:25.536547 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6895f6d0-2f0d-428c-bb01-9a8a859d6f80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "ram": 4096}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:25.640891 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6895f6d0-2f0d-428c-bb01-9a8a859d6f80 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.540563 Aug 24 08:48:25.649814 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 8/17] 10.222.0.55 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 08:48:25.654278 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-25e74bbd-14da-48b5-a83c-df481bd23c58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:25.732717 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-25e74bbd-14da-48b5-a83c-df481bd23c58 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078905 Aug 24 08:48:25.732717 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 10/18] 10.222.0.55 () {64 vars in 1336 bytes} [Wed Aug 24 08:48:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:48:28.302967 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6895f6d0-2f0d-428c-bb01-9a8a859d6f80 admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:28.304388 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6895f6d0-2f0d-428c-bb01-9a8a859d6f80 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002266 Aug 24 08:48:28.304993 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 9/19] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:48:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:48:28.825826 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3be4bc0b-cc53-4153-900d-f2705bffa6c7 admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:28.852642 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-3be4bc0b-cc53-4153-900d-f2705bffa6c7 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.540013 Aug 24 08:48:28.853516 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 11/20] 10.222.0.55 () {60 vars in 1292 bytes} [Wed Aug 24 08:48:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:48:31.819470 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6895f6d0-2f0d-428c-bb01-9a8a859d6f80 admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:31.820572 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6895f6d0-2f0d-428c-bb01-9a8a859d6f80 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001684 Aug 24 08:48:31.820934 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 10/21] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:48:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:32.309185 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-62eb0097-1435-4275-b6a7-59aa6e9faccc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "ram": 512, "id": "1", "rxtx_factor": 1.0, "disk": 1}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:32.369196 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-62eb0097-1435-4275-b6a7-59aa6e9faccc admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.540938 Aug 24 08:48:32.370365 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 12/22] 10.222.0.55 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:32.383003 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-501696f5-9893-4200-b8a6-d9f5b9102fdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:32.528068 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-501696f5-9893-4200-b8a6-d9f5b9102fdd admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.149130 Aug 24 08:48:32.529484 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 11/23] 10.222.0.55 () {64 vars in 1333 bytes} [Wed Aug 24 08:48:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:48:34.948187 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-62eb0097-1435-4275-b6a7-59aa6e9faccc admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:34.949257 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-62eb0097-1435-4275-b6a7-59aa6e9faccc admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002212 Aug 24 08:48:34.949672 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 13/24] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:48:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:35.351113 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d51b21d6-f7eb-461c-95ef-27348cb874b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "disk": 20}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:35.499698 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d51b21d6-f7eb-461c-95ef-27348cb874b4 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.542702 Aug 24 08:48:35.500254 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 12/25] 10.222.0.55 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:35.512739 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-665e1e56-8799-4ef0-a4e1-d8b1704f686f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:35.601573 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-665e1e56-8799-4ef0-a4e1-d8b1704f686f admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092632 Aug 24 08:48:35.602062 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 14/26] 10.222.0.55 () {64 vars in 1333 bytes} [Wed Aug 24 08:48:35 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:48:38.387711 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d51b21d6-f7eb-461c-95ef-27348cb874b4 admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:38.389500 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d51b21d6-f7eb-461c-95ef-27348cb874b4 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002506 Aug 24 08:48:38.390593 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 13/27] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:48:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:39.182111 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-fd9a1624-e07a-4321-bb46-0a682ed7312b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "swap": 0, "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:39.296228 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-fd9a1624-e07a-4321-bb46-0a682ed7312b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.895639 Aug 24 08:48:39.296785 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 15/28] 10.222.0.55 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:39.311222 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-edcb7deb-d8c7-407e-9a43-ac9f6c827d4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:39.320693 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:39.397474 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-edcb7deb-d8c7-407e-9a43-ac9f6c827d4d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090008 Aug 24 08:48:39.399419 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 14/29] 10.222.0.55 () {64 vars in 1333 bytes} [Wed Aug 24 08:48:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:48:43.565680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-fd9a1624-e07a-4321-bb46-0a682ed7312b admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:43.567518 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-fd9a1624-e07a-4321-bb46-0a682ed7312b admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002549 Aug 24 08:48:43.568261 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 16/30] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:48:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:44.231571 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f731e160-a68a-45ab-8e54-a51c238894fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "id": "4", "vcpus": 4, "disk": 80, "swap": 0, "rxtx_factor": 1.0}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:44.347133 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f731e160-a68a-45ab-8e54-a51c238894fc admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.768108 Aug 24 08:48:44.348267 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 15/31] 10.222.0.55 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:44.366349 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-12169fad-d841-4d23-8db5-9c82829be39c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:44.454971 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-12169fad-d841-4d23-8db5-9c82829be39c admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095845 Aug 24 08:48:44.468620 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 17/32] 10.222.0.55 () {64 vars in 1333 bytes} [Wed Aug 24 08:48:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:48:47.100448 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f731e160-a68a-45ab-8e54-a51c238894fc admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:47.101492 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f731e160-a68a-45ab-8e54-a51c238894fc admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 24 08:48:47.102175 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 16/33] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:48:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:47.588012 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c3c4342b-4b0e-41ea-99f6-7fc81a5f17d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:47.594501 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:47.689438 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c3c4342b-4b0e-41ea-99f6-7fc81a5f17d4 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.579572 Aug 24 08:48:47.690350 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 18/34] 10.222.0.55 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:47.704865 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9f5ceb97-82c8-4d6d-9055-6c265eb08d97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:47.827059 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9f5ceb97-82c8-4d6d-9055-6c265eb08d97 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126857 Aug 24 08:48:47.827664 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 17/35] 10.222.0.55 () {64 vars in 1333 bytes} [Wed Aug 24 08:48:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:49:05.172859 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c3c4342b-4b0e-41ea-99f6-7fc81a5f17d4 admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:05.173905 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c3c4342b-4b0e-41ea-99f6-7fc81a5f17d4 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 24 08:49:05.174306 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 19/36] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:49:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:05.185970 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:05.622157 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-358648ee-79f8-494d-857e-41024ec4f4b0 admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:05.643312 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-358648ee-79f8-494d-857e-41024ec4f4b0 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.462481 Aug 24 08:49:05.644117 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 18/37] 10.222.0.55 () {60 vars in 1292 bytes} [Wed Aug 24 08:49:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:49:06.748297 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c3c4342b-4b0e-41ea-99f6-7fc81a5f17d4 admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:06.749386 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c3c4342b-4b0e-41ea-99f6-7fc81a5f17d4 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001665 Aug 24 08:49:06.750244 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 20/38] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:07.326956 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e93e1ba0-b9b9-4db4-aba4-f12216d5bf9f admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:07.334807 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-e93e1ba0-b9b9-4db4-aba4-f12216d5bf9f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e93e1ba0-b9b9-4db4-aba4-f12216d5bf9f admin admin] Request method failure captured: Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Accept: application/json Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Accept-Encoding: gzip, deflate Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Connection: keep-alive Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Content-Length: 0 Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Host: 10.222.0.55 Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Openstack-Api-Version: compute 2.90 Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: User-Agent: python-novaclient Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABjBeYCIewMHX0majsQAppwoZY-JXQ7zfOv7j_lg5dL6PZDw_gZy4mCXnItWw3cv9b88Om6oorsf0R7fy_eB_5Mz5SkACKwh8bF0vBn_F8grSwUJdMFJitkDvNVy0MwjKCwsmQejdnu92rI11HrQaTD0RPZg2NYeDfSkKG3rM2M3zhPAec Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Project-Id: 6ad87fa1813247aba83e93f886f34eb3 Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Project-Name: admin Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Role: member,admin,reader Aug 24 08:49:07.339374 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Roles: member,admin,reader Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6ad87fa1813247aba83e93f886f34eb3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Tenant: admin Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 6ad87fa1813247aba83e93f886f34eb3 Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Tenant-Name: admin Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User: admin Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User-Id: 28800687066c4de989fe1940c9a30412 Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User-Name: admin Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: method: > Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: exception: Flavor 42 could not be found. Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: action_args: {'id': '42'} Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:49:07.341200 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:07.342217 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:07.343358 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e93e1ba0-b9b9-4db4-aba4-f12216d5bf9f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:49:07.344444 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e93e1ba0-b9b9-4db4-aba4-f12216d5bf9f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.450213 Aug 24 08:49:07.344444 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 19/39] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Aug 24 08:49:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 452 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:07.354095 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-68414d0e-c0e0-4c90-ac2c-41e16a035ce8 admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:07.377801 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-68414d0e-c0e0-4c90-ac2c-41e16a035ce8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027285 Aug 24 08:49:07.378376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 21/40] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Aug 24 08:49:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:49:07.389398 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-35ec0e1a-32ea-44e2-99a2-85a3820a9aff admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:07.414543 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-35ec0e1a-32ea-44e2-99a2-85a3820a9aff admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029234 Aug 24 08:49:07.415129 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 20/41] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Aug 24 08:49:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:49:07.424864 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-45cb726a-d137-48b8-9b06-37d888511a93 admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:07.431206 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-45cb726a-d137-48b8-9b06-37d888511a93 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-45cb726a-d137-48b8-9b06-37d888511a93 admin admin] Request method failure captured: Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Accept: application/json Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Accept-Encoding: gzip, deflate Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Connection: keep-alive Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Content-Length: 0 Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Host: 10.222.0.55 Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Openstack-Api-Version: compute 2.90 Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: User-Agent: python-novaclient Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABjBeYCIewMHX0majsQAppwoZY-JXQ7zfOv7j_lg5dL6PZDw_gZy4mCXnItWw3cv9b88Om6oorsf0R7fy_eB_5Mz5SkACKwh8bF0vBn_F8grSwUJdMFJitkDvNVy0MwjKCwsmQejdnu92rI11HrQaTD0RPZg2NYeDfSkKG3rM2M3zhPAec Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Project-Id: 6ad87fa1813247aba83e93f886f34eb3 Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Project-Name: admin Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Role: member,admin,reader Aug 24 08:49:07.434544 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Roles: member,admin,reader Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6ad87fa1813247aba83e93f886f34eb3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Tenant: admin Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 6ad87fa1813247aba83e93f886f34eb3 Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Tenant-Name: admin Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User: admin Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User-Id: 28800687066c4de989fe1940c9a30412 Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User-Name: admin Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: method: > Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: exception: Flavor 42 could not be found. Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: action_args: {'id': '42'} Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:49:07.442567 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:07.443655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:07.445376 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-45cb726a-d137-48b8-9b06-37d888511a93 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:49:07.448212 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-45cb726a-d137-48b8-9b06-37d888511a93 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014718 Aug 24 08:49:07.448212 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 22/42] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Aug 24 08:49:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:08.443590 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-35ec0e1a-32ea-44e2-99a2-85a3820a9aff admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:08.444686 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-35ec0e1a-32ea-44e2-99a2-85a3820a9aff admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 24 08:49:08.445090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 21/43] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:09.061973 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-224d6ba6-f2f6-4b1e-a48a-bdebf9d571e1 admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:09.067532 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-224d6ba6-f2f6-4b1e-a48a-bdebf9d571e1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-224d6ba6-f2f6-4b1e-a48a-bdebf9d571e1 admin admin] Request method failure captured: Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Accept: application/json Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Accept-Encoding: gzip, deflate Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Connection: keep-alive Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Content-Length: 0 Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Host: 10.222.0.55 Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Openstack-Api-Version: compute 2.90 Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: User-Agent: python-novaclient Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABjBeYETRjTuraD8v-vRHv_Q30KUioUNPhT-yrzhNkaHGl9Pn2qFmaxkkxqKt3l0kwn3J31-nEryVtfnJs6k60lNkDYYxcFUMc9ifHvVbhLpVi3zSFSp-xBQyCFKcun-y_YjhBvi1E7oktGqz7h4G1eDXHJ1IpHOhgATrVtfd68ztxLsYU Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Project-Id: 6ad87fa1813247aba83e93f886f34eb3 Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Project-Name: admin Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Role: member,admin,reader Aug 24 08:49:09.069099 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Roles: member,admin,reader Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6ad87fa1813247aba83e93f886f34eb3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Tenant: admin Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 6ad87fa1813247aba83e93f886f34eb3 Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Tenant-Name: admin Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User: admin Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User-Id: 28800687066c4de989fe1940c9a30412 Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User-Name: admin Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: method: > Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: exception: Flavor 84 could not be found. Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: action_args: {'id': '84'} Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:49:09.070680 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:09.072029 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:09.073494 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-224d6ba6-f2f6-4b1e-a48a-bdebf9d571e1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:49:09.074736 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-224d6ba6-f2f6-4b1e-a48a-bdebf9d571e1 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.483705 Aug 24 08:49:09.074736 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 23/44] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Aug 24 08:49:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 485 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:09.082191 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-26437826-a9eb-4f98-98a9-108099e77721 admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:09.098087 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-26437826-a9eb-4f98-98a9-108099e77721 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019401 Aug 24 08:49:09.098642 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 22/45] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Aug 24 08:49:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:49:09.108635 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-319d8408-a6b9-4efa-bd16-ea551d3cac4b admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:09.123709 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-319d8408-a6b9-4efa-bd16-ea551d3cac4b admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018543 Aug 24 08:49:09.124285 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 24/46] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Aug 24 08:49:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:49:09.134574 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3d2c2c03-e146-4b20-abba-ca1542a491f4 admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:09.139989 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-3d2c2c03-e146-4b20-abba-ca1542a491f4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3d2c2c03-e146-4b20-abba-ca1542a491f4 admin admin] Request method failure captured: Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Accept: application/json Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Accept-Encoding: gzip, deflate Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Connection: keep-alive Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Content-Length: 0 Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Host: 10.222.0.55 Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Openstack-Api-Version: compute 2.90 Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: User-Agent: python-novaclient Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABjBeYETRjTuraD8v-vRHv_Q30KUioUNPhT-yrzhNkaHGl9Pn2qFmaxkkxqKt3l0kwn3J31-nEryVtfnJs6k60lNkDYYxcFUMc9ifHvVbhLpVi3zSFSp-xBQyCFKcun-y_YjhBvi1E7oktGqz7h4G1eDXHJ1IpHOhgATrVtfd68ztxLsYU Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Project-Id: 6ad87fa1813247aba83e93f886f34eb3 Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Project-Name: admin Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Role: member,admin,reader Aug 24 08:49:09.141546 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Roles: member,admin,reader Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6ad87fa1813247aba83e93f886f34eb3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Tenant: admin Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 6ad87fa1813247aba83e93f886f34eb3 Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Tenant-Name: admin Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User: admin Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User-Id: 28800687066c4de989fe1940c9a30412 Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User-Name: admin Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: method: > Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: exception: Flavor 84 could not be found. Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: action_args: {'id': '84'} Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:49:09.142904 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:09.145075 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:09.146279 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3d2c2c03-e146-4b20-abba-ca1542a491f4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:49:09.147382 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3d2c2c03-e146-4b20-abba-ca1542a491f4 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012568 Aug 24 08:49:09.147382 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 23/47] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Aug 24 08:49:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 08:49:10.146868 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-319d8408-a6b9-4efa-bd16-ea551d3cac4b admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:10.147901 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-319d8408-a6b9-4efa-bd16-ea551d3cac4b admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Aug 24 08:49:10.148356 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 25/48] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:10.747516 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a9daa494-cbb1-41c5-b916-48a251dd12fc admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:10.753565 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-a9daa494-cbb1-41c5-b916-48a251dd12fc admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a9daa494-cbb1-41c5-b916-48a251dd12fc admin admin] Request method failure captured: Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Accept: application/json Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Accept-Encoding: gzip, deflate Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Connection: keep-alive Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Content-Length: 0 Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Host: 10.222.0.55 Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Openstack-Api-Version: compute 2.90 Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: User-Agent: python-novaclient Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABjBeYG8sDMH7C5828wshzxCA8hH58OLn7ki8eFP1WP10QyMrSDEvvMN3XCI6peKK0sJFSoGQHHNOJn_YCkb2vD3MIgyUU9W3M_OM1nYg0aLvMhVZ4IOuLEGc_YRKLzqU3OvB9W8QYkKInNQGKVi4sstfmYVwlLc6nFU2EswNivXi5pwcI Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Project-Id: 6ad87fa1813247aba83e93f886f34eb3 Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Project-Name: admin Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Role: member,admin,reader Aug 24 08:49:10.755090 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Roles: member,admin,reader Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6ad87fa1813247aba83e93f886f34eb3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Tenant: admin Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 6ad87fa1813247aba83e93f886f34eb3 Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-Tenant-Name: admin Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User: admin Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User-Id: 28800687066c4de989fe1940c9a30412 Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: X-User-Name: admin Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: method: > Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: exception: Flavor 451 could not be found. Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: action_args: {'id': '451'} Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:49:10.757051 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:10.758671 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Aug 24 08:49:10.761822 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a9daa494-cbb1-41c5-b916-48a251dd12fc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:49:10.763563 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a9daa494-cbb1-41c5-b916-48a251dd12fc admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.462706 Aug 24 08:49:10.763563 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 24/49] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Aug 24 08:49:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 464 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:10.766898 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-44a04938-8b24-4cf9-baae-f1cc34a435af admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:10.782160 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-44a04938-8b24-4cf9-baae-f1cc34a435af admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018737 Aug 24 08:49:10.782715 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 26/50] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Aug 24 08:49:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:49:10.794985 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:10.811380 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020720 Aug 24 08:49:10.811940 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 25/51] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Aug 24 08:49:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:49:10.823803 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ffccec70-7b8c-4bb8-9dcc-ef186fedefb4 admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:10.829280 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-ffccec70-7b8c-4bb8-9dcc-ef186fedefb4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ffccec70-7b8c-4bb8-9dcc-ef186fedefb4 admin admin] Request method failure captured: Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Accept: application/json Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Accept-Encoding: gzip, deflate Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Connection: keep-alive Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Content-Length: 0 Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Host: 10.222.0.55 Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Openstack-Api-Version: compute 2.90 Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: User-Agent: python-novaclient Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABjBeYG8sDMH7C5828wshzxCA8hH58OLn7ki8eFP1WP10QyMrSDEvvMN3XCI6peKK0sJFSoGQHHNOJn_YCkb2vD3MIgyUU9W3M_OM1nYg0aLvMhVZ4IOuLEGc_YRKLzqU3OvB9W8QYkKInNQGKVi4sstfmYVwlLc6nFU2EswNivXi5pwcI Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Project-Id: 6ad87fa1813247aba83e93f886f34eb3 Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Project-Name: admin Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Role: member,admin,reader Aug 24 08:49:10.830798 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Roles: member,admin,reader Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6ad87fa1813247aba83e93f886f34eb3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ad87fa1813247aba83e93f886f34eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Tenant: admin Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 6ad87fa1813247aba83e93f886f34eb3 Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-Tenant-Name: admin Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User: admin Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User-Id: 28800687066c4de989fe1940c9a30412 Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: X-User-Name: admin Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: method: > Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: exception: Flavor 451 could not be found. Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: action_args: {'id': '451'} Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:49:10.832484 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:10.833437 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Aug 24 08:49:10.834996 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ffccec70-7b8c-4bb8-9dcc-ef186fedefb4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:49:10.836292 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ffccec70-7b8c-4bb8-9dcc-ef186fedefb4 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013638 Aug 24 08:49:10.836292 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 27/52] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Aug 24 08:49:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:11.820781 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:11.822299 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Aug 24 08:49:11.822756 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 26/53] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:12.394988 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a633da59-8a4c-415c-ae40-1665cb50b496 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:49:12.488086 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a633da59-8a4c-415c-ae40-1665cb50b496 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.526664 Aug 24 08:49:12.488655 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 28/54] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Aug 24 08:49:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:49:13.483523 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:13.484526 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 24 08:49:13.484962 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 27/55] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:14.045490 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e69322b5-ccc6-44fa-a512-803292ad0be1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:49:14.124063 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e69322b5-ccc6-44fa-a512-803292ad0be1 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.499289 Aug 24 08:49:14.124662 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 29/56] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Aug 24 08:49:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:49:15.111653 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:15.112736 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 24 08:49:15.113202 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 28/57] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:15.697481 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-03f7c775-67bd-45c7-b16b-01d353b536e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:49:15.803218 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-03f7c775-67bd-45c7-b16b-01d353b536e6 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.546862 Aug 24 08:49:15.803689 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 30/58] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Aug 24 08:49:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:49:16.804182 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:16.805280 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 24 08:49:16.805711 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 29/59] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:17.365247 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-6bd1b70f-cc18-4fae-bffe-ed611a63a0b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:49:17.460605 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-6bd1b70f-cc18-4fae-bffe-ed611a63a0b9 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.511569 Aug 24 08:49:17.461180 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 31/60] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Aug 24 08:49:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:49:18.469724 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:18.470732 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 24 08:49:18.471130 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 30/61] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:49:19.008381 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-be7e20b1-5097-4f46-8a7a-23ef93153440 admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:19.029339 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-be7e20b1-5097-4f46-8a7a-23ef93153440 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.420547 Aug 24 08:49:19.029873 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 32/62] 10.222.0.55 () {60 vars in 1202 bytes} [Wed Aug 24 08:49:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:50:13.737573 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:50:13.738545 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b7ffdbc4-e6f6-4c1e-a23b-e01a8cea6f5d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 24 08:50:13.738953 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 31/63] 10.222.0.55 () {54 vars in 931 bytes} [Wed Aug 24 08:50:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:50:13.749511 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:50:14.136910 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-6b074e29-7006-4e10-9298-1f7a3ae0a567 admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:50:14.158365 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-6b074e29-7006-4e10-9298-1f7a3ae0a567 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.413344 Aug 24 08:50:14.159001 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 33/64] 10.222.0.55 () {60 vars in 1292 bytes} [Wed Aug 24 08:50:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:50:14.180270 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=14 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:50:14.184013 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1ad5846c-4bc8-4eab-8a0c-4e4048e67c47 admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:50:14.191747 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1ad5846c-4bc8-4eab-8a0c-4e4048e67c47 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012881 Aug 24 08:50:14.194970 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 32/65] 10.222.0.55 () {60 vars in 1283 bytes} [Wed Aug 24 08:50:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:50:14.205123 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-bdceeb6d-08ae-4557-b90d-1a696596313f admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:50:14.213717 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-bdceeb6d-08ae-4557-b90d-1a696596313f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012281 Aug 24 08:50:14.214263 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 34/66] 10.222.0.55 () {60 vars in 1286 bytes} [Wed Aug 24 08:50:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:50:14.228079 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3787bbf4-08c4-4e3c-aa08-b07bf571fc33 admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:50:14.236191 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3787bbf4-08c4-4e3c-aa08-b07bf571fc33 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012050 Aug 24 08:50:14.236803 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 33/67] 10.222.0.55 () {60 vars in 1286 bytes} [Wed Aug 24 08:50:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:50:14.248789 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a666b84d-c886-4256-b686-1cd402b96768 admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:50:14.256635 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a666b84d-c886-4256-b686-1cd402b96768 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011378 Aug 24 08:50:14.257725 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 35/68] 10.222.0.55 () {60 vars in 1283 bytes} [Wed Aug 24 08:50:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:53:27.569416 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3787bbf4-08c4-4e3c-aa08-b07bf571fc33 admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:27.570424 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3787bbf4-08c4-4e3c-aa08-b07bf571fc33 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 24 08:53:27.570818 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 34/69] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Aug 24 08:53:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:53:27.710180 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=6 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:53:27.873545 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e5e8d2ae-4a44-4488-9f18-984ba5927e9b admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:27.875843 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:53:27.875843 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: warnings.warn(msg) Aug 24 08:53:27.876979 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e5e8d2ae-4a44-4488-9f18-984ba5927e9b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:27.877449 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e5e8d2ae-4a44-4488-9f18-984ba5927e9b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:27.877877 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e5e8d2ae-4a44-4488-9f18-984ba5927e9b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:27.878663 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e5e8d2ae-4a44-4488-9f18-984ba5927e9b admin admin] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:27.879169 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e5e8d2ae-4a44-4488-9f18-984ba5927e9b admin admin] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:27.879584 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e5e8d2ae-4a44-4488-9f18-984ba5927e9b admin admin] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:27.913642 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e5e8d2ae-4a44-4488-9f18-984ba5927e9b admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204917 Aug 24 08:53:27.914228 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 36/70] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Aug 24 08:53:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:53:28.734789 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3787bbf4-08c4-4e3c-aa08-b07bf571fc33 admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:28.736004 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3787bbf4-08c4-4e3c-aa08-b07bf571fc33 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Aug 24 08:53:28.736482 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 35/71] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Aug 24 08:53:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:53:28.932716 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b5c0f40e-f672-4e9a-a3a8-03ffe77f9ead admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:28.935122 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:53:28.935122 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: warnings.warn(msg) Aug 24 08:53:28.936246 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b5c0f40e-f672-4e9a-a3a8-03ffe77f9ead admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:28.936747 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b5c0f40e-f672-4e9a-a3a8-03ffe77f9ead admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:28.937166 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b5c0f40e-f672-4e9a-a3a8-03ffe77f9ead admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:28.937874 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b5c0f40e-f672-4e9a-a3a8-03ffe77f9ead admin admin] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:28.938312 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b5c0f40e-f672-4e9a-a3a8-03ffe77f9ead admin admin] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:28.938720 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b5c0f40e-f672-4e9a-a3a8-03ffe77f9ead admin admin] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:28.957864 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b5c0f40e-f672-4e9a-a3a8-03ffe77f9ead admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077368 Aug 24 08:53:28.958340 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 37/72] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Aug 24 08:53:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:53:40.186226 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3787bbf4-08c4-4e3c-aa08-b07bf571fc33 admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:40.187229 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3787bbf4-08c4-4e3c-aa08-b07bf571fc33 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 24 08:53:40.187618 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 36/73] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Aug 24 08:53:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:53:40.330316 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=4 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:53:40.331048 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=4 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:53:40.331670 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=8 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:53:40.380338 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-85f6279d-07de-4fb1-9218-37d281b245c5 admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:40.383023 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:53:40.383023 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: warnings.warn(msg) Aug 24 08:53:40.384188 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-85f6279d-07de-4fb1-9218-37d281b245c5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:40.384697 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-85f6279d-07de-4fb1-9218-37d281b245c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:40.385152 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-85f6279d-07de-4fb1-9218-37d281b245c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:40.385943 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-85f6279d-07de-4fb1-9218-37d281b245c5 admin admin] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:40.386390 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-85f6279d-07de-4fb1-9218-37d281b245c5 admin admin] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:40.386807 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-85f6279d-07de-4fb1-9218-37d281b245c5 admin admin] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:40.412378 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-85f6279d-07de-4fb1-9218-37d281b245c5 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086549 Aug 24 08:53:40.412971 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 38/74] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Aug 24 08:53:40 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:53:41.240304 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3787bbf4-08c4-4e3c-aa08-b07bf571fc33 admin admin] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:41.241330 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3787bbf4-08c4-4e3c-aa08-b07bf571fc33 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 08:53:41.241727 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 37/75] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Aug 24 08:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:53:41.438274 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-af5f507b-76e9-4f21-a4fb-da6c2ff2164a admin admin] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:41.440687 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:53:41.440687 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: warnings.warn(msg) Aug 24 08:53:41.441782 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-af5f507b-76e9-4f21-a4fb-da6c2ff2164a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:41.442252 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-af5f507b-76e9-4f21-a4fb-da6c2ff2164a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:41.442675 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-af5f507b-76e9-4f21-a4fb-da6c2ff2164a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:41.443417 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-af5f507b-76e9-4f21-a4fb-da6c2ff2164a admin admin] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:41.443888 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-af5f507b-76e9-4f21-a4fb-da6c2ff2164a admin admin] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:41.444302 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-af5f507b-76e9-4f21-a4fb-da6c2ff2164a admin admin] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:41.466185 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-af5f507b-76e9-4f21-a4fb-da6c2ff2164a admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080759 Aug 24 08:53:41.466674 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 39/76] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Aug 24 08:53:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:54:42.402357 dv-cinder-852210-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 08:54:42.402890 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: Wed Aug 24 08:54:42 2022 - graceful shutdown triggered... Aug 24 08:54:42.403319 dv-cinder-852210-4-iscsi devstack@n-api.service[117937]: Gracefully killing worker 1 (pid: 117937)... Aug 24 08:54:42.403670 dv-cinder-852210-4-iscsi devstack@n-api.service[117938]: Gracefully killing worker 2 (pid: 117938)... Aug 24 08:54:43.403863 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: worker 1 buried after 1 seconds Aug 24 08:54:43.403863 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: worker 2 buried after 1 seconds Aug 24 08:54:43.403863 dv-cinder-852210-4-iscsi devstack@n-api.service[117916]: goodbye to uWSGI. Aug 24 08:54:43.405480 dv-cinder-852210-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 08:54:43.406039 dv-cinder-852210-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 08:54:43.408902 dv-cinder-852210-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 08:54:43.418378 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 08:54:43.421092 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 08:54:43 2022] *** Aug 24 08:54:43.421092 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 08:54:43.421092 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 08:54:43.421092 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: nodename: dv-cinder-852210-4-iscsi Aug 24 08:54:43.421092 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: machine: x86_64 Aug 24 08:54:43.421092 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: clock source: unix Aug 24 08:54:43.421092 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: pcre jit disabled Aug 24 08:54:43.421092 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: detected number of CPU cores: 4 Aug 24 08:54:43.421092 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: current working directory: / Aug 24 08:54:43.421092 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: detected binary path: /usr/bin/uwsgi-core Aug 24 08:54:43.421092 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: your processes number limit is 47680 Aug 24 08:54:43.421855 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: your memory page size is 4096 bytes Aug 24 08:54:43.421855 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: detected max file descriptor number: 2048 Aug 24 08:54:43.421855 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: lock engine: pthread robust mutexes Aug 24 08:54:43.421855 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: thunder lock: enabled Aug 24 08:54:43.421855 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 08:54:43.421855 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 08:54:43.462616 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: Python main interpreter initialized at 0x55aa485df9c0 Aug 24 08:54:43.462616 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: python threads support enabled Aug 24 08:54:43.462616 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: your server socket listen backlog is limited to 100 connections Aug 24 08:54:43.462616 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: your mercy for graceful operations on workers is 90 seconds Aug 24 08:54:43.462616 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 08:54:43.462616 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: *** Operational MODE: preforking *** Aug 24 08:54:43.462616 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: *** uWSGI is running in multiple interpreter mode *** Aug 24 08:54:43.462616 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: spawned uWSGI master process (pid: 132968) Aug 24 08:54:43.462389 dv-cinder-852210-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 08:54:43.463390 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: spawned uWSGI worker 1 (pid: 132984, cores: 1) Aug 24 08:54:43.463390 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: spawned uWSGI worker 2 (pid: 132985, cores: 1) Aug 24 08:54:43.463390 dv-cinder-852210-4-iscsi devstack@n-api.service[132968]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 08:54:44.122946 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 08:54:44.141651 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 08:54:45.270547 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:54:45.270547 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: from cryptography.utils import int_from_bytes Aug 24 08:54:45.271236 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:54:45.271236 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: from cryptography.utils import int_from_bytes Aug 24 08:54:45.320445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:54:45.320445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: from cryptography.utils import int_from_bytes Aug 24 08:54:45.321081 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:54:45.321081 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: from cryptography.utils import int_from_bytes Aug 24 08:54:47.681097 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 08:54:47.681671 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 08:54:47.681963 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 08:54:47.682260 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 08:54:47.682514 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 08:54:47.682925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.683231 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.683557 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.683878 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.684376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.684720 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.685049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.685369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.685702 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.686038 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.686269 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.686617 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-4-iscsi {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.686920 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.687267 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.687529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.687846 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.688149 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.688469 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.688821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.689329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.689852 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.690066 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.690385 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.690862 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.691039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.691347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.691668 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.691982 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.692318 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.692671 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.693057 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-4-iscsi {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.693418 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.693694 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.694007 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.694431 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.694783 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.695092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.695412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.695735 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.696056 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.696367 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.696719 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.697038 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.697358 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.697657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.697963 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.698275 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.698594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.698901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.699200 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.699450 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.699756 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.700097 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.700405 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.700755 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.701007 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.701258 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.701575 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.701895 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.702202 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.702510 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.702815 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.703119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.703430 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.703732 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.704035 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.704339 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.704690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.705005 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.705326 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.705633 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.705953 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.706364 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.706613 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.706923 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.707266 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.707583 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.707888 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.708210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.708531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.708863 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.709169 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.709478 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.709799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.710174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.710479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.710730 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.711030 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.711336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.711656 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.711961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.712265 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.712606 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.713497 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.713497 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.713497 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.713782 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.714075 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.714381 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.714687 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.714996 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.715298 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.715599 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.715925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.716247 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.716577 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.716881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.718076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.718076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.718076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.718076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.719294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.719294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.719294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.719294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.719612 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.719932 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.720142 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.720465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.720804 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.721107 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.721427 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.721729 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.722030 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.722332 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.722632 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.722930 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.723231 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.723535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.723834 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.724130 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.724448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.724798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.725108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.725415 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.726243 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.726565 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.726905 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.727238 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.727677 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.727999 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.728334 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.728700 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.729019 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.729332 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.729648 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.730057 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.730284 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.730594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.730907 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.731222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.731540 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.731872 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.732189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.732505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.732850 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.733158 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.733475 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.733805 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.734137 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.734448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.734791 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.735138 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.735451 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.735772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.736097 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.736407 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.736753 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.737063 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.737384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.737715 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.738029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.738344 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.738655 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.738964 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.739274 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.739588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.739908 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.740228 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.740707 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.740888 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.741186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.742077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.742386 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.742700 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.743010 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.743319 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.743628 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.743928 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.744240 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.744573 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.745040 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.745241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.745527 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.748602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.748602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.748602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.748602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.748602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.748602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.748602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.748602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.749273 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.749273 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.749273 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.749273 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.749606 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.749909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.750217 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.750522 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.750830 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.751138 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.751447 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.751757 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.752078 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.752389 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.752829 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.753060 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.753388 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.753689 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.754010 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.754336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.754696 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.754950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.755255 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.755628 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.755858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.756252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.756465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.756789 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.757128 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.757427 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.757728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.758035 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.758350 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.758660 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.758975 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.759253 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.759554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.759896 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.760198 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.760619 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.760891 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.761210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.761533 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.761814 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 08:54:47.762287 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.762449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 08:54:47.762594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.762594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.762901 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 08:54:47.763134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.763286 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 08:54:47.763432 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.763584 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 08:54:47.763763 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.763999 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.764159 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.764314 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.764459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.764645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.764805 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.764951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.765095 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.765095 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.765379 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.765538 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.765708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.765928 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.766078 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.766223 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.766468 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.766637 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.766807 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.767053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.767274 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.767425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.767579 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.767733 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.767879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-4-iscsi {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.768032 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.768185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.768338 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.768484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.768669 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.768669 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.768976 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.769128 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.769272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.769425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.769572 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.769723 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.769868 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.770011 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.770161 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.770323 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.770561 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.770743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.770890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.771085 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.771246 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.771414 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.771569 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.771715 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.771715 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.772000 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.772158 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.772304 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.772463 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.772669 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.772827 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.772982 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.773153 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.773384 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.773549 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.773703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.773850 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.774021 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.774264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.774429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-4-iscsi {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.774584 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.774737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.774896 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.775041 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.775199 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.775360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.775759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.775759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.776133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.776301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.776482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.776733 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.776898 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.777045 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.777189 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.777437 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.777599 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.777755 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.777901 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.778056 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.778210 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.778370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.778525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.778671 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.778823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.778979 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.779132 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.779305 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.779462 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.779608 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.779752 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.779904 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.780050 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.780210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.780363 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.780509 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.780794 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.780940 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.781149 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.781149 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.781479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.781634 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.781780 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.781924 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.782280 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.782280 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.782634 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.782782 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.782927 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.783075 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.783230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.783230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.783630 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.783790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.783945 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.784100 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.784267 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.784511 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.784696 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.784853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.784999 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.785153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.785300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.785446 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.785602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.785754 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.785900 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.786054 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.786285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.786445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.786599 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.786772 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.786993 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.787159 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.787317 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.787556 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.787716 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.787716 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.788013 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.788160 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.788890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.789042 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.789199 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.789346 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.789506 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.789654 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.789806 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.789961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.790106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.790252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.790420 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.790570 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.790734 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.790959 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.791109 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.791305 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.791461 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.791461 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.791751 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.791907 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.792052 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.792205 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.792350 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.792522 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.792750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.792905 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.793057 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.793219 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.793371 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.793522 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.793764 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.793923 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.794086 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.794247 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.794400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.794672 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.794852 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.795006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.795157 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.795317 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.795469 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.795621 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.795958 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.796131 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.796419 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.796595 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.796765 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.796928 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.797197 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.797357 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.797624 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.797787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.797940 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.798091 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.798252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.798404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.798555 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.798720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.798874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.799036 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.799227 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.799403 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.799555 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.799707 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.799858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.800021 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.800183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.800342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.800501 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.800678 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.800842 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.801090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.801302 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.801462 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.801626 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.801799 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.801964 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.802124 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.802284 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.802443 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.802604 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.802758 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.802920 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.803080 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.803240 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.803400 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.803575 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.803745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.804584 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.804863 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.805033 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.805198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.805362 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.805523 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.805684 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.805857 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.806135 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.806321 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.806564 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.806742 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.806895 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.806895 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.807209 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.807452 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.807616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.807864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.808023 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.808175 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.808327 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.808493 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.808680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.808834 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.809005 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.809158 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.809323 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.809323 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.809622 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.809782 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.809941 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.810100 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.810261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.810421 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.810575 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.810742 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.810895 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.811075 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.811354 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.811354 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.811662 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.811823 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.811987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.812140 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.812305 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:47.812458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.812656 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.812812 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.812963 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.813206 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.813369 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.813522 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.813683 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.813881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.814057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.814299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.814299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.814603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.814764 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.815032 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.815191 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.815353 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.815518 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.815671 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.815823 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.815983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.816144 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.816296 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.816454 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.816708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.816868 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.817020 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.817184 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.817338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.817579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.817757 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.818005 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.818172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.818334 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.818488 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.818640 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.818792 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.818952 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.819112 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.819277 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.819277 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.819623 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.819793 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.819953 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.820115 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.820275 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.820427 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.820608 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.820766 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.820919 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.821079 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.821239 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.821524 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.821692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.821856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.821856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.822183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.822335 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.822487 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.822638 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.822790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.822949 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.823116 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.823275 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.823426 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.823578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.823729 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.823889 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.824053 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.824204 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.824458 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.824677 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.824841 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.825025 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.825317 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.825490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.825644 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.825804 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.825964 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.826126 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.826288 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.826451 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.826610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.826863 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.827024 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.827187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.827341 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.827500 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.827755 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.827924 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.828167 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.828343 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.828506 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.828684 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.828849 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.829011 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.829172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.829448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.829606 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.829781 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.829942 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.830094 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.830263 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.830416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.830575 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.830735 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.830899 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.831058 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.831224 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.831383 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.831665 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.831841 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.831841 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.832159 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.832322 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.832476 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.832708 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.832957 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.833121 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.833296 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.833450 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.833604 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.833764 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.833916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.834077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.834244 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.834622 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.834783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.834936 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.835126 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.835294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.835464 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.835648 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.835893 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.836059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.836211 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.836374 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.836549 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.836724 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.836904 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.837139 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.837298 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.837460 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.837613 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.837784 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.838037 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.838296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.838466 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.838630 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.838792 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.838944 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.839104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.839257 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.839417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.839579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.839733 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.839896 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.840060 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.840212 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.840443 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.840641 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.840809 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.840971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.841130 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.841291 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.841456 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.841728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.841900 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.842062 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.842062 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.842383 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.842383 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.842684 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.842837 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.842990 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.843148 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.843301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.843465 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.843625 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.843785 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.843946 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.844107 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.844269 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.844439 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.844614 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.844848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.845017 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.845171 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.845337 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.845496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.845658 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.845817 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.846085 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.846254 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.846416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.846569 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.846740 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.846900 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.847061 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.847310 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.847485 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.847639 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.847791 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.847950 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.848194 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.848450 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.848660 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.848818 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.848989 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.849142 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.849295 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.849460 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.849622 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.849782 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.849935 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.850094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.850246 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.850411 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.850564 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.851225 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.851404 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.851569 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.851838 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.852009 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.852171 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.852335 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.852491 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.852678 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.852848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.853010 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.853170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.853322 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.853475 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.853635 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.853811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.853974 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.854135 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.854295 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.854447 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.854608 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.854773 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.855027 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.855187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.855340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.855493 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.855646 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.855819 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.855973 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.856233 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.856393 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.856723 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.856895 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.857058 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.857226 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.857441 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.857599 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.857761 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.857922 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.858075 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.858075 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.858583 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.858751 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.859016 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.859186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.859341 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.859493 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.859652 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.859814 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.859967 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.860139 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.860300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.860452 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.860699 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.860857 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.861010 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.861171 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.861332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.861492 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.861653 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.861951 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.862403 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.862568 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.862721 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.862883 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.863037 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.863210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.863373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.863527 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.863680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.863839 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.864000 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.864160 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.864322 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.864476 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.864664 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.865212 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.865381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.865535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.865712 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.865866 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.866028 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.866028 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.866510 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.867254 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.867426 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.867588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.867742 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.867894 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.867894 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.868216 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.868491 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.868762 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.868922 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.869076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.869238 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.869400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.869554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.869707 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.869867 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.870019 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.870171 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.870333 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.870486 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.870650 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.870810 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.870963 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.871123 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.871285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.871445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.871605 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.871765 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.871986 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.872230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.872408 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.872663 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.872836 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.873008 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.873177 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.873344 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.873500 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.873661 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.873815 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.873974 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.874134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.874368 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.874525 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.874677 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.874830 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.874990 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.875183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.875183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.875576 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.875737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.875899 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.876059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.876221 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.876382 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.876577 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.876826 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.876999 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.877154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.877414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.877575 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.877728 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.877881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.878034 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.878186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.878348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.878526 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.878773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.879010 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.879171 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.879340 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.879502 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.879676 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.879829 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.879982 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.880142 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.880304 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.880466 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.880644 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.880809 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.880970 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.881122 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.881283 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.881445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.881598 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.881769 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.881769 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.882144 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.882407 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.882632 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.882804 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.882959 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.883119 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.883286 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.883286 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.883586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.883739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.883901 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.884062 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.884224 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.884384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.884607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.884779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.884942 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.885096 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.885262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.885434 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.885675 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.885834 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.885987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.886160 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.886315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.886468 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.886630 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.886791 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.887066 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.887233 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.887406 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.887636 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.887795 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.887916 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.888046 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.888142 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.888229 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.888315 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.888417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.888506 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.888622 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.888711 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.888945 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.889163 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.889292 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.889416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.889529 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.889652 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.889775 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.889897 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.890031 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.890148 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.890268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.890388 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.890511 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.890633 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.890753 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.890867 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.891113 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.891283 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.891407 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.891534 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.891648 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.891759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.891871 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.891990 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.892147 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.892285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.892420 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.892640 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.892770 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.892893 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.893024 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.893147 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.893269 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.893391 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.893507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.893507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.893507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.893507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.893507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.893507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.893507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.893507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.894361 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.894474 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.894586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.894698 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.894824 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.894824 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.895044 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.895164 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.895277 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.895397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.895519 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.895650 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.895857 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.895987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.896132 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.896274 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.896417 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.896633 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.896765 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.896881 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.896994 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.897227 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.897350 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.897473 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.897636 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.897830 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.897957 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.898086 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.898200 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.898323 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.898323 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.898323 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.898323 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.898323 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.898851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.899071 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.899284 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.899407 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.899529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.899654 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.899767 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.899880 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.899880 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.900088 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.900214 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.900329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.900441 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.900878 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.901011 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.901138 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.901262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.901382 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.901501 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.901625 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.901749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.901863 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.901989 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.902110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.902290 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.902410 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.902522 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.902652 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.902858 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.902985 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.903100 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.903211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.903322 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.903448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.903570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.903692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.903813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.903926 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.904038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.904160 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.904274 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.904386 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.904506 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.904657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.904790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.904918 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.905039 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.905152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.905264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.905376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.905498 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.905619 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.905733 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.905873 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.906088 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.906332 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.906581 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.906737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.906862 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.906977 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.907098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.907230 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.907465 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.907597 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.907729 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.907870 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.908063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.908191 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.908320 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.908434 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.908609 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.908730 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.908843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.908955 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.909104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.909320 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.909522 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.909641 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.909761 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.909882 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.910005 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.910120 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.910232 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.910350 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.910350 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.910579 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.910701 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.910814 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.910926 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.911046 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.911171 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.911297 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.911412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.911524 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.911643 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.911766 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.911766 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.911987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.911987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.912253 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.912253 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.912493 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.912644 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.912775 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.912988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.913118 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.913762 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.913925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.914060 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.914176 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.914297 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.914411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.914524 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.914644 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.914771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.914885 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.914997 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.915123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.915238 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.915358 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.915481 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.915606 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.915721 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.915833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.915943 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.916083 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.916286 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.916415 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.916556 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.916696 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.916832 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.916966 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.917082 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.917202 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.917325 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.917458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.917672 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.917819 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.923607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.923762 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.923900 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.924020 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.924135 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.924267 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.924391 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.924514 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.926933 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.927101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.927307 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.927437 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.927552 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.927686 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.927813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.927936 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.928065 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.928188 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.928312 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.928426 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.928625 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.928779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.928988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.929645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.929781 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.929914 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.930047 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.930178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.930325 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.930467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.930467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.930732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.930874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.931020 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.931153 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.931293 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.931293 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.931553 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.931701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.931860 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.931999 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.932141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.932286 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.932470 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.932674 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.932821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.932955 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.933087 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.933243 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.933389 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.933535 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.933678 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.933812 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.933951 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.934084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.934217 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.934434 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.934569 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.934569 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.934819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.934959 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.935097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.935240 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.935375 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.935506 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.935651 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.937525 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.937696 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.937837 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.937980 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.938115 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.938248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.938382 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.938525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.938667 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.938809 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.938943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.939083 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.939225 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.939373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.939508 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.939641 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.939773 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.939906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.940039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.940039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.940311 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.940461 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.940611 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.940757 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.940899 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.941034 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.941180 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.941313 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.941445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.941579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.942576 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.943739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.943886 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.944219 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.944397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.944713 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.944713 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.945374 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.945525 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.945669 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.945833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.945990 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.946138 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.946303 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.946897 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.947037 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.947170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.947170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.947428 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.947567 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.947714 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.947849 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.947849 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.948106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.948249 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.948249 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.948514 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.948679 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.948679 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.948972 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.949105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.949247 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.949380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.949380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.949638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.949777 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.949777 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.950037 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.950169 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.950301 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.950433 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.950433 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.950688 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.950841 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.950841 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.951130 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.951261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.951393 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.951524 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.951524 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.951788 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.951931 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.952065 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.952210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.952356 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.952496 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.952709 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.952844 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.952975 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.953135 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.953283 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.953416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.953416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.953683 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.953813 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.953813 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.954086 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.954221 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.954221 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.954478 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.954621 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.954764 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.954897 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.954897 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.955190 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.955460 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.955460 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.955732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.955865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.955865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.956149 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.956575 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.957028 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.964622 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.964622 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.964870 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.964962 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.965049 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.965144 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.965241 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.965329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.965445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.965593 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.965687 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.965790 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.965886 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.965973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.965973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.966196 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.966288 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 08:54:47.966386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.966386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.966386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.966386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.966386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.966386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.966386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.966386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.967417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.967417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.967417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.967417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.967417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.967417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.967417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.967417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.968819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.969589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.969589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.969589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.969589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.969589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.969589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.969589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.969589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.970890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.971638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.971638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.971638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.971638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.971638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.971638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.971638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.971638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.972231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.972231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.972231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.972231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.972231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.972231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.972231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.972231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.972972 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.972972 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.973136 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.973532 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.973854 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.974196 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.974529 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.974863 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.975187 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.975513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.976398 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.976746 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.977099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.977420 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.977755 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.978152 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.978440 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.978763 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.979074 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.979403 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.979721 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.980457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.980902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.981236 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.981574 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.981908 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.982235 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.982765 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.983088 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.984125 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.984448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.984805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.989783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.989783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.989783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.989783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.989783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.989783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.989783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.989783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.990513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.990513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.990513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.990513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.990513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.990513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.990513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.990513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.991148 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.991148 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.991148 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.991463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.992279 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.992480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.992935 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.993257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.993570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.993908 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.994333 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.994756 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.995024 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.995397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.995728 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.996048 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.996368 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.996758 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.997104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.997692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.998032 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.998360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.998705 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.999045 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.999360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:47.999696 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.000029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.000379 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.000702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.001022 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.001366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.001694 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.002024 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.002341 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.002658 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.002974 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.003290 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.003606 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.003981 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.004302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.004649 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.004971 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.005293 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.005644 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.005993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.006319 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.007745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.007745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.007745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.007745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.008339 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.008339 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.008652 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.008992 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.009311 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.009623 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.010062 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.010420 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.010749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.011079 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.011399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.011777 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.012109 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.012431 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.012780 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.013098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.013194 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO dbcounter [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] Registered counter for database nova_api Aug 24 08:54:48.013473 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.013823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.014157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.014490 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.014802 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.015114 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.015422 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.015789 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.016113 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.016427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.016762 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.018833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.018833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.018833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.018833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.018833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.018833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.019380 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.019380 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.019598 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.019890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.020199 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.020507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.020838 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.021156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.021474 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.021802 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.022131 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.022445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.023272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.023611 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.024046 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.024333 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.024741 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.025094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.025417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.025999 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.026332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.026693 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.027021 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.027370 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.027720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.028040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.028354 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.028724 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.029047 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.030048 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.030048 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.030362 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.030522 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.030727 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.031112 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.031438 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.031772 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.032094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.032414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.032776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.033094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.033414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.033747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.034072 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.034379 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.034701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.034887 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_db.sqlalchemy.engines [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.035076 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.035392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.035717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.036037 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.036371 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.036728 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.037045 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.037378 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.037707 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.038067 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.038953 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.039314 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.039644 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.039969 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.040285 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.040616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.040868 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 08:54:48.042341 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writer thread running {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:48.097754 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.context [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7d12875-14d7-416e-86d0-e7719092bb5f(cell1) {{(pid=132985) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 08:54:48.102320 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:54:48.102792 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:54:48.103680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO dbcounter [None req-28147a95-034a-4806-8990-02982d30cf17 None None] Registered counter for database nova_api Aug 24 08:54:48.104339 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:54:48.105293 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:54:48.105538 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:54:48.107496 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:54:48.109524 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO dbcounter [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] Registered counter for database nova_cell0 Aug 24 08:54:48.113569 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO dbcounter [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] Registered counter for database nova_cell1 Aug 24 08:54:48.121675 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_db.sqlalchemy.engines [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.122497 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_db.sqlalchemy.engines [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.124715 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_db.sqlalchemy.engines [None req-28147a95-034a-4806-8990-02982d30cf17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.130436 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writer thread running {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:48.130780 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writer thread running {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:48.131510 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writer thread running {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:48.188213 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.context [None req-28147a95-034a-4806-8990-02982d30cf17 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7d12875-14d7-416e-86d0-e7719092bb5f(cell1) {{(pid=132984) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 08:54:48.192402 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-28147a95-034a-4806-8990-02982d30cf17 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:54:48.192899 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-28147a95-034a-4806-8990-02982d30cf17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:54:48.194501 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-28147a95-034a-4806-8990-02982d30cf17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:54:48.195230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-28147a95-034a-4806-8990-02982d30cf17 None None] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:54:48.195690 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-28147a95-034a-4806-8990-02982d30cf17 None None] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:54:48.197738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-28147a95-034a-4806-8990-02982d30cf17 None None] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:54:48.199863 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO dbcounter [None req-28147a95-034a-4806-8990-02982d30cf17 None None] Registered counter for database nova_cell0 Aug 24 08:54:48.204409 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO dbcounter [None req-28147a95-034a-4806-8990-02982d30cf17 None None] Registered counter for database nova_cell1 Aug 24 08:54:48.215242 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_db.sqlalchemy.engines [None req-28147a95-034a-4806-8990-02982d30cf17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.216283 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_db.sqlalchemy.engines [None req-28147a95-034a-4806-8990-02982d30cf17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.223477 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writer thread running {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:48.224795 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writer thread running {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:48.282209 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO dbcounter [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] Registered counter for database nova_cell0 Aug 24 08:54:48.289817 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_db.sqlalchemy.engines [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.294392 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writer thread running {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:48.375952 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO dbcounter [None req-28147a95-034a-4806-8990-02982d30cf17 None None] Registered counter for database nova_cell0 Aug 24 08:54:48.384268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_db.sqlalchemy.engines [None req-28147a95-034a-4806-8990-02982d30cf17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.388923 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writer thread running {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:48.609787 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: WARNING keystonemiddleware.auth_token [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:54:48.617213 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: WARNING keystonemiddleware.auth_token [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:54:48.712850 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: WARNING keystonemiddleware.auth_token [None req-28147a95-034a-4806-8990-02982d30cf17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:54:48.720222 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: WARNING keystonemiddleware.auth_token [None req-28147a95-034a-4806-8990-02982d30cf17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:54:48.961341 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: WARNING keystonemiddleware.auth_token [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:54:48.967627 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: WARNING keystonemiddleware.auth_token [None req-62bceedf-7c8b-4c0f-9745-1a6428f0ddbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:54:48.973243 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aa485df9c0 pid: 132985 (default app) Aug 24 08:54:49.083408 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: WARNING keystonemiddleware.auth_token [None req-28147a95-034a-4806-8990-02982d30cf17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:54:49.090089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: WARNING keystonemiddleware.auth_token [None req-28147a95-034a-4806-8990-02982d30cf17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:54:49.095640 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aa485df9c0 pid: 132984 (default app) Aug 24 08:55:24.144947 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=3 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:24.146014 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=3 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:24.146632 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=3 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:24.147421 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=3 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:25.418943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5c44c46a-871e-4d2d-907e-6194d2de7fee tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Action: 'create', calling method: .version_select at 0x7f16b03f65e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1349255842", "metadata": {"Type": "work"}}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5c44c46a-871e-4d2d-907e-6194d2de7fee tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Request method failure captured: Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 122 Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBed87yKbwqViSJ7FjvPpxJH4hZnPQChBNak7LuBEYR1FXfce5kAg4ZX9w3S3OKVF-xbmNIsakB3Rs3uyaMfTQZJzKBo5eK5GELVK_Sprt_OFJJ5RRLOKbP8ugoOA6xwP9cF8XzTZ-zeo2z9yJ2sfkKvkBK56IN2BSKQeIba63MLW9MU Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 460e817ed5584689a98e649af18c4451 Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 08:55:25.425329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 08:55:25.430692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/460e817ed5584689a98e649af18c4451"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_460e817ed5584689a98e649af18c4451", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/460e817ed5584689a98e649af18c4451"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/460e817ed5584689a98e649af18c4451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:55:25.430692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:25.430692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 460e817ed5584689a98e649af18c4451 Aug 24 08:55:25.430692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:25.430692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-VolumesNegativeTest-1456304169-project Aug 24 08:55:25.430692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 08:55:25.430692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 08:55:25.430692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 5e8fd689c9af47ffac97e81255fc04f9 Aug 24 08:55:25.430692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-VolumesNegativeTest-1456304169-project Aug 24 08:55:25.430692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Aug 24 08:55:25.430692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1349255842", "metadata": {"Type": "work"}}} Aug 24 08:55:25.430692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: Aug 24 08:55:25.430692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1349255842', 'metadata': {'Type': 'work'}}}} Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise error Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:25.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 08:55:25.433152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 08:55:25.434624 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 08:55:25.434624 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.434624 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5c44c46a-871e-4d2d-907e-6194d2de7fee tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:25.434624 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5c44c46a-871e-4d2d-907e-6194d2de7fee tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.293699 Aug 24 08:55:25.434624 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 1/1] 10.222.0.55 () {60 vars in 1156 bytes} [Wed Aug 24 08:55:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1296 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:55:25.441271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=3 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:25.442297 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=3 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:25.443192 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=3 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:25.444426 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=3 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:25.660125 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-769a693c-048c-4663-9105-bcd7ff2c1286 tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Action: 'create', calling method: .version_select at 0x7f16b03c70d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1802834891", "metadata": {"Type": "work"}}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-769a693c-048c-4663-9105-bcd7ff2c1286 tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Request method failure captured: Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 120 Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBed87yKbwqViSJ7FjvPpxJH4hZnPQChBNak7LuBEYR1FXfce5kAg4ZX9w3S3OKVF-xbmNIsakB3Rs3uyaMfTQZJzKBo5eK5GELVK_Sprt_OFJJ5RRLOKbP8ugoOA6xwP9cF8XzTZ-zeo2z9yJ2sfkKvkBK56IN2BSKQeIba63MLW9MU Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 460e817ed5584689a98e649af18c4451 Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 08:55:25.666257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 08:55:25.667667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/460e817ed5584689a98e649af18c4451"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_460e817ed5584689a98e649af18c4451", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/460e817ed5584689a98e649af18c4451"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/460e817ed5584689a98e649af18c4451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:55:25.667667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:25.667667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 460e817ed5584689a98e649af18c4451 Aug 24 08:55:25.667667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:25.667667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-VolumesNegativeTest-1456304169-project Aug 24 08:55:25.667667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 08:55:25.667667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 08:55:25.667667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 5e8fd689c9af47ffac97e81255fc04f9 Aug 24 08:55:25.667667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-VolumesNegativeTest-1456304169-project Aug 24 08:55:25.667667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Aug 24 08:55:25.667667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1802834891", "metadata": {"Type": "work"}}} Aug 24 08:55:25.667667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: Aug 24 08:55:25.667667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1802834891', 'metadata': {'Type': 'work'}}}} Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise error Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi '0' Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:25.668485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 08:55:25.669787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 08:55:25.671602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 08:55:25.671602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.671602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-769a693c-048c-4663-9105-bcd7ff2c1286 tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:25.671602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-769a693c-048c-4663-9105-bcd7ff2c1286 tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.232843 Aug 24 08:55:25.671602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 1/2] 10.222.0.55 () {60 vars in 1156 bytes} [Wed Aug 24 08:55:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 235 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:55:25.678779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0c4a6b3a-c816-493e-9374-c12437dce903 tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Action: 'create', calling method: .version_select at 0x7f16b03f6670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-630241048", "metadata": {"Type": "work"}}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0c4a6b3a-c816-493e-9374-c12437dce903 tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Request method failure captured: Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 118 Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBed87yKbwqViSJ7FjvPpxJH4hZnPQChBNak7LuBEYR1FXfce5kAg4ZX9w3S3OKVF-xbmNIsakB3Rs3uyaMfTQZJzKBo5eK5GELVK_Sprt_OFJJ5RRLOKbP8ugoOA6xwP9cF8XzTZ-zeo2z9yJ2sfkKvkBK56IN2BSKQeIba63MLW9MU Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 460e817ed5584689a98e649af18c4451 Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 08:55:25.683101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 08:55:25.684482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/460e817ed5584689a98e649af18c4451"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_460e817ed5584689a98e649af18c4451", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/460e817ed5584689a98e649af18c4451"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/460e817ed5584689a98e649af18c4451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:55:25.684482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:25.684482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 460e817ed5584689a98e649af18c4451 Aug 24 08:55:25.684482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:25.684482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-VolumesNegativeTest-1456304169-project Aug 24 08:55:25.684482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 08:55:25.684482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 08:55:25.684482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 5e8fd689c9af47ffac97e81255fc04f9 Aug 24 08:55:25.684482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-VolumesNegativeTest-1456304169-project Aug 24 08:55:25.684482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Aug 24 08:55:25.684482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-630241048", "metadata": {"Type": "work"}}} Aug 24 08:55:25.684482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: Aug 24 08:55:25.684482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-630241048', 'metadata': {'Type': 'work'}}}} Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise error Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi '' Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:25.685396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 08:55:25.686682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 08:55:25.688400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 08:55:25.688400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:25.688400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0c4a6b3a-c816-493e-9374-c12437dce903 tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:25.688400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0c4a6b3a-c816-493e-9374-c12437dce903 tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010287 Aug 24 08:55:25.688400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 2/3] 10.222.0.55 () {60 vars in 1156 bytes} [Wed Aug 24 08:55:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:55:25.697027 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-00e9e9ff-6dd7-4560-9959-395196e1c77e tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Calling method '.version_select at 0x7f16b03c7ca0>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:27.546270 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-00e9e9ff-6dd7-4560-9959-395196e1c77e tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] HTTP exception thrown: Volume tempest-invalid-1732924112 could not be found. Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-00e9e9ff-6dd7-4560-9959-395196e1c77e tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Request method failure captured: Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1732924112 HTTP/1.1 Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBed87yKbwqViSJ7FjvPpxJH4hZnPQChBNak7LuBEYR1FXfce5kAg4ZX9w3S3OKVF-xbmNIsakB3Rs3uyaMfTQZJzKBo5eK5GELVK_Sprt_OFJJ5RRLOKbP8ugoOA6xwP9cF8XzTZ-zeo2z9yJ2sfkKvkBK56IN2BSKQeIba63MLW9MU Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 460e817ed5584689a98e649af18c4451 Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 08:55:27.552198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 08:55:27.553845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/460e817ed5584689a98e649af18c4451"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_460e817ed5584689a98e649af18c4451", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/460e817ed5584689a98e649af18c4451"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/460e817ed5584689a98e649af18c4451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:55:27.553845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:27.553845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 460e817ed5584689a98e649af18c4451 Aug 24 08:55:27.553845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:27.553845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-VolumesNegativeTest-1456304169-project Aug 24 08:55:27.553845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 08:55:27.553845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 08:55:27.553845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 5e8fd689c9af47ffac97e81255fc04f9 Aug 24 08:55:27.553845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-VolumesNegativeTest-1456304169-project Aug 24 08:55:27.553845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: Aug 24 08:55:27.553845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Volume tempest-invalid-1732924112 could not be found. Aug 24 08:55:27.553845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': 'tempest-invalid-1732924112'} Aug 24 08:55:27.553845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1732924112 could not be found. (HTTP 404) (Request-ID: req-e9314dd5-dc97-402e-9686-ff14f6ddf60f) Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:27.554773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 08:55:27.556128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1732924112 could not be found. Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:55:27.557738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1732924112 could not be found. Aug 24 08:55:27.559172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:27.559172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:27.559172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:27.559172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:27.559172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:27.559172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:27.559172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:55:27.559172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:55:27.559172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1732924112 could not be found. Aug 24 08:55:27.559172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:27.560962 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-00e9e9ff-6dd7-4560-9959-395196e1c77e tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Returning 404 to user: Volume tempest-invalid-1732924112 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:27.562063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-00e9e9ff-6dd7-4560-9959-395196e1c77e tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1732924112" status: 404 len: 99 microversion: 2.1 time: 1.870927 Aug 24 08:55:27.564980 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1218 bytes} [Wed Aug 24 08:55:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1732924112 => generated 99 bytes in 1875 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 08:55:27.575336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2b248312-c5b4-4d78-8e6f-396431d3cf38 tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004923 Aug 24 08:55:27.576469 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 3/5] 10.222.0.55 () {58 vars in 1140 bytes} [Wed Aug 24 08:55:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 08:55:27.589195 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-aa1f5cf9-3bcd-4ea8-8c6f-2ff2808f6639 tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005050 Aug 24 08:55:27.590006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 3/6] 10.222.0.55 () {58 vars in 1137 bytes} [Wed Aug 24 08:55:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 08:55:27.599131 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7fef710b-ab24-49a8-b8b0-79916bcb37ae tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Calling method '.version_select at 0x7f16b02b3430>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:28.528835 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-7fef710b-ab24-49a8-b8b0-79916bcb37ae tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] HTTP exception thrown: Volume f264374b-72c3-4f81-8bbc-a666706436c5 could not be found. Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7fef710b-ab24-49a8-b8b0-79916bcb37ae tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Request method failure captured: Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: DELETE /compute/v2.1/os-volumes/f264374b-72c3-4f81-8bbc-a666706436c5 HTTP/1.1 Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBed87yKbwqViSJ7FjvPpxJH4hZnPQChBNak7LuBEYR1FXfce5kAg4ZX9w3S3OKVF-xbmNIsakB3Rs3uyaMfTQZJzKBo5eK5GELVK_Sprt_OFJJ5RRLOKbP8ugoOA6xwP9cF8XzTZ-zeo2z9yJ2sfkKvkBK56IN2BSKQeIba63MLW9MU Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 460e817ed5584689a98e649af18c4451 Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 08:55:28.533205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 08:55:28.534327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/460e817ed5584689a98e649af18c4451"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_460e817ed5584689a98e649af18c4451", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/460e817ed5584689a98e649af18c4451"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/460e817ed5584689a98e649af18c4451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:55:28.534327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:28.534327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 460e817ed5584689a98e649af18c4451 Aug 24 08:55:28.534327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:28.534327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-VolumesNegativeTest-1456304169-project Aug 24 08:55:28.534327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 08:55:28.534327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 08:55:28.534327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 5e8fd689c9af47ffac97e81255fc04f9 Aug 24 08:55:28.534327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-VolumesNegativeTest-1456304169-project Aug 24 08:55:28.534327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: Aug 24 08:55:28.534327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Volume f264374b-72c3-4f81-8bbc-a666706436c5 could not be found. Aug 24 08:55:28.534327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': 'f264374b-72c3-4f81-8bbc-a666706436c5'} Aug 24 08:55:28.534327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f264374b-72c3-4f81-8bbc-a666706436c5 could not be found. (HTTP 404) (Request-ID: req-ffc41254-5760-4ee5-8337-bd18dcb1da8e) Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:28.535071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 08:55:28.536029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f264374b-72c3-4f81-8bbc-a666706436c5 could not be found. Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 08:55:28.537657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:55:28.539894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f264374b-72c3-4f81-8bbc-a666706436c5 could not be found. Aug 24 08:55:28.539894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.539894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:28.539894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.539894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:28.539894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:28.539894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:28.539894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:55:28.539894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:55:28.539894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f264374b-72c3-4f81-8bbc-a666706436c5 could not be found. Aug 24 08:55:28.539894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.542492 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7fef710b-ab24-49a8-b8b0-79916bcb37ae tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Returning 404 to user: Volume f264374b-72c3-4f81-8bbc-a666706436c5 could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:28.543979 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7fef710b-ab24-49a8-b8b0-79916bcb37ae tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/f264374b-72c3-4f81-8bbc-a666706436c5" status: 404 len: 109 microversion: 2.1 time: 0.948945 Aug 24 08:55:28.545154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1248 bytes} [Wed Aug 24 08:55:27 2022] DELETE /compute/v2.1/os-volumes/f264374b-72c3-4f81-8bbc-a666706436c5 => generated 109 bytes in 951 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:55:28.558855 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-db3e61db-9620-4308-9f6e-ee91b01efacc tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Calling method '.version_select at 0x7f16b0c239d0>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:28.612202 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-db3e61db-9620-4308-9f6e-ee91b01efacc tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] HTTP exception thrown: Volume 739cfe1e-92b2-4740-8c60-a72c3bb95259 could not be found. Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-db3e61db-9620-4308-9f6e-ee91b01efacc tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Request method failure captured: Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/os-volumes/739cfe1e-92b2-4740-8c60-a72c3bb95259 HTTP/1.1 Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBed87yKbwqViSJ7FjvPpxJH4hZnPQChBNak7LuBEYR1FXfce5kAg4ZX9w3S3OKVF-xbmNIsakB3Rs3uyaMfTQZJzKBo5eK5GELVK_Sprt_OFJJ5RRLOKbP8ugoOA6xwP9cF8XzTZ-zeo2z9yJ2sfkKvkBK56IN2BSKQeIba63MLW9MU Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 460e817ed5584689a98e649af18c4451 Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 08:55:28.614332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 08:55:28.619073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/460e817ed5584689a98e649af18c4451"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_460e817ed5584689a98e649af18c4451", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/460e817ed5584689a98e649af18c4451"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/460e817ed5584689a98e649af18c4451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:55:28.619073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:28.619073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 460e817ed5584689a98e649af18c4451 Aug 24 08:55:28.619073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-VolumesNegativeTest-1456304169 Aug 24 08:55:28.619073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-VolumesNegativeTest-1456304169-project Aug 24 08:55:28.619073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 08:55:28.619073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 08:55:28.619073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 5e8fd689c9af47ffac97e81255fc04f9 Aug 24 08:55:28.619073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-VolumesNegativeTest-1456304169-project Aug 24 08:55:28.619073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: Aug 24 08:55:28.619073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Volume 739cfe1e-92b2-4740-8c60-a72c3bb95259 could not be found. Aug 24 08:55:28.619073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '739cfe1e-92b2-4740-8c60-a72c3bb95259'} Aug 24 08:55:28.619073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 739cfe1e-92b2-4740-8c60-a72c3bb95259 could not be found. (HTTP 404) (Request-ID: req-c02a2832-71b3-4717-833e-8dc5fdb588d4) Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:28.620737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:55:28.621628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 739cfe1e-92b2-4740-8c60-a72c3bb95259 could not be found. Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 08:55:28.622463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 739cfe1e-92b2-4740-8c60-a72c3bb95259 could not be found. Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 739cfe1e-92b2-4740-8c60-a72c3bb95259 could not be found. Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-db3e61db-9620-4308-9f6e-ee91b01efacc tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] Returning 404 to user: Volume 739cfe1e-92b2-4740-8c60-a72c3bb95259 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-db3e61db-9620-4308-9f6e-ee91b01efacc tempest-VolumesNegativeTest-1456304169 tempest-VolumesNegativeTest-1456304169-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/739cfe1e-92b2-4740-8c60-a72c3bb95259" status: 404 len: 109 microversion: 2.1 time: 0.065106 Aug 24 08:55:28.623417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:28 2022] GET /compute/v2.1/os-volumes/739cfe1e-92b2-4740-8c60-a72c3bb95259 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:55:39.153571 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-134021670", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "networks": [{"uuid": "a826bc78-1676-4ad6-8d3b-a4a0d3db5913"}]}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:39.437299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.network.neutron [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] validate_networks() for [('a826bc78-1676-4ad6-8d3b-a4a0d3db5913', None, None, None, None, None)] {{(pid=132985) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:55:42.360286 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Flavor limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:55:42.361446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Image limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:55:42.362442 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Flavor pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:55:42.363151 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Image pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:55:42.363877 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:55:42.393083 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:42.400881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:42.400881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:42.400881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:42.400881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:42.401418 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:42.437014 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Getting quotas for project d0c61eee777c46779632c08ee11946c5. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:42.448637 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Getting quotas for user 718a0dfdef714e358a74ad8e424b1b8a and project d0c61eee777c46779632c08ee11946c5. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:42.479873 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Going to run 1 instances... {{(pid=132985) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:55:42.492917 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:55:42.783808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ad3f68b0-98fc-427a-99cb-aa4c8979bfb4 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.194145 Aug 24 08:55:42.787403 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 5/9] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 08:55:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 4196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:55:42.817064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d6de7e65-e748-4de3-8718-b9a67915fec5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:42.820629 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d6de7e65-e748-4de3-8718-b9a67915fec5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:43.193921 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d6de7e65-e748-4de3-8718-b9a67915fec5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:43.243772 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d6de7e65-e748-4de3-8718-b9a67915fec5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1214 microversion: 2.1 time: 0.437787 Aug 24 08:55:43.244797 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 5/10] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:42 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1214 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:44.270991 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-848b6e3f-cb9e-4f4a-9597-955f3953c5c2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:44.272409 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-848b6e3f-cb9e-4f4a-9597-955f3953c5c2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:44.590405 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-848b6e3f-cb9e-4f4a-9597-955f3953c5c2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:44.612955 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-848b6e3f-cb9e-4f4a-9597-955f3953c5c2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1214 microversion: 2.1 time: 0.346763 Aug 24 08:55:44.613535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 6/11] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:44 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1214 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:44.938089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c5e9426e-68fe-4ea4-a2f8-569d443be512 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Action: 'create', calling method: .version_select at 0x7f16b018c3a0>, body: {"keypair": {"name": "tempest-keypair-518661313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF15zhQHvtWQAQJoMC+ZBdbQNIIUQjYg4KZr1YOq2MOCcyIcsnu9ZHK39wvtPqe3+AsDwIvASStVPVWvVD072eEQkQf3LY6bCquBQiTe1ZA5h22cDkJe+LbTW/imxnOzrA=="}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:45.051575 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-c5e9426e-68fe-4ea4-a2f8-569d443be512 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Getting quotas for project 02d5c74d88a24eb9814f49a6ff4eca56. Resources: {'key_pairs'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:45.069445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-c5e9426e-68fe-4ea4-a2f8-569d443be512 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Getting quotas for user f5d7aee76519492e81b0048edebba36f and project 02d5c74d88a24eb9814f49a6ff4eca56. Resources: {'key_pairs'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:45.280167 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c5e9426e-68fe-4ea4-a2f8-569d443be512 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.605352 Aug 24 08:55:45.289103 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 6/12] 10.222.0.55 () {60 vars in 1159 bytes} [Wed Aug 24 08:55:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:45.374067 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d4f92e23-f0a9-4f35-a4b8-080480adf78e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Action: 'create', calling method: .version_select at 0x7f16af886ca0>, body: {"keypair": {"name": "tempest-keypair-1540102404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCD9F4qCJ4YpLiFhkUWQd9wJl9bVIXqpNxJpDNxwPd62EkqHE07Q5cGLcWUyIeSKjHF/cShEC4sSvVC6HY0fb8V2ljGKKt6i2rrQPsRSQzYtn4UJCV2V97CgWbVCor1qQ=="}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:45.450710 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-d4f92e23-f0a9-4f35-a4b8-080480adf78e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for project 3809ac47fe214dda92729d4c89648a17. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:45.458149 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-d4f92e23-f0a9-4f35-a4b8-080480adf78e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for user 993697d33b7841668b1eabcdcd6b40f9 and project 3809ac47fe214dda92729d4c89648a17. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:45.635414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-369cc37a-a21a-4e9d-86ff-8341d7bb4a1c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:45.638555 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-369cc37a-a21a-4e9d-86ff-8341d7bb4a1c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:45.667795 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d4f92e23-f0a9-4f35-a4b8-080480adf78e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.504830 Aug 24 08:55:45.668788 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 7/13] 10.222.0.55 () {60 vars in 1159 bytes} [Wed Aug 24 08:55:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:45.850808 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-369cc37a-a21a-4e9d-86ff-8341d7bb4a1c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:45.858615 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-369cc37a-a21a-4e9d-86ff-8341d7bb4a1c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1214 microversion: 2.1 time: 0.227822 Aug 24 08:55:45.870348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 7/14] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:45 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1214 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:46.682160 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d1e13e73-d2cd-4afa-ad37-c4b10e50a17c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Action: 'create', calling method: .version_select at 0x7f16af886af0>, body: {"keypair": {"name": "tempest-keypair-606371214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCB7F9p9+NNJHGMNNEA278uQx8u4RGt5wFlbE+vwJCdlT6/ooc8phLntEoYKVZSqiuVGIjgJZE4QVLM21+dvKNrGhIpW26n5SHx//lQiC1mHP5uyTf5sfbingmmdfsYYg=="}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:46.712933 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-d1e13e73-d2cd-4afa-ad37-c4b10e50a17c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Getting quotas for project a69447ca2f314084925442b7f8c9ee2e. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:46.718095 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-d1e13e73-d2cd-4afa-ad37-c4b10e50a17c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Getting quotas for user 1105970982014891902ebbb9904a57a5 and project a69447ca2f314084925442b7f8c9ee2e. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:46.864122 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d1e13e73-d2cd-4afa-ad37-c4b10e50a17c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.421702 Aug 24 08:55:46.865466 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 8/15] 10.222.0.55 () {62 vars in 1200 bytes} [Wed Aug 24 08:55:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 424 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 08:55:46.887163 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1490ae9a-4587-4baf-82d1-244e6a227df0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:46.890364 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1490ae9a-4587-4baf-82d1-244e6a227df0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:46.903014 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1490ae9a-4587-4baf-82d1-244e6a227df0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:46.907627 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1490ae9a-4587-4baf-82d1-244e6a227df0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:46.909059 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1490ae9a-4587-4baf-82d1-244e6a227df0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:46.910306 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1490ae9a-4587-4baf-82d1-244e6a227df0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:46.910854 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1490ae9a-4587-4baf-82d1-244e6a227df0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:46.912077 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1490ae9a-4587-4baf-82d1-244e6a227df0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:47.215207 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1490ae9a-4587-4baf-82d1-244e6a227df0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:47.236715 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1490ae9a-4587-4baf-82d1-244e6a227df0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1210 microversion: 2.1 time: 0.355397 Aug 24 08:55:47.237916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 8/16] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:46 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1210 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:48.258238 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-66ba0d97-b226-4387-bf09-8c209a79d79e tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:48.259196 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-66ba0d97-b226-4387-bf09-8c209a79d79e tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:48.277176 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-66ba0d97-b226-4387-bf09-8c209a79d79e tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:48.277176 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-66ba0d97-b226-4387-bf09-8c209a79d79e tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:48.277176 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-66ba0d97-b226-4387-bf09-8c209a79d79e tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:48.278231 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-66ba0d97-b226-4387-bf09-8c209a79d79e tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:48.279578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-66ba0d97-b226-4387-bf09-8c209a79d79e tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:48.280446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-66ba0d97-b226-4387-bf09-8c209a79d79e tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:48.806454 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-66ba0d97-b226-4387-bf09-8c209a79d79e tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:48.830831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-66ba0d97-b226-4387-bf09-8c209a79d79e tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1274 microversion: 2.1 time: 0.576487 Aug 24 08:55:48.831431 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 9/17] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:48 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1274 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:49.857859 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-293fc4e7-e60d-4b63-b8e2-760ba95cb69d tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:49.858421 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-293fc4e7-e60d-4b63-b8e2-760ba95cb69d tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:49.870447 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-293fc4e7-e60d-4b63-b8e2-760ba95cb69d tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:49.870950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-293fc4e7-e60d-4b63-b8e2-760ba95cb69d tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:49.871395 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-293fc4e7-e60d-4b63-b8e2-760ba95cb69d tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:49.872105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-293fc4e7-e60d-4b63-b8e2-760ba95cb69d tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:49.872637 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-293fc4e7-e60d-4b63-b8e2-760ba95cb69d tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:49.882283 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-293fc4e7-e60d-4b63-b8e2-760ba95cb69d tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:50.029720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2136173510", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:50.121786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-293fc4e7-e60d-4b63-b8e2-760ba95cb69d tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:50.140645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-293fc4e7-e60d-4b63-b8e2-760ba95cb69d tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1272 microversion: 2.1 time: 0.285863 Aug 24 08:55:50.142837 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 10/18] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:49 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1272 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:50.177522 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.network.neutron [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] validate_networks() for [('1f91305e-a47a-4ee8-9410-ebf6faafeb89', None, None, None, None, None)] {{(pid=132984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:55:51.164814 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-15d28471-1cf6-47e2-925f-2feee611db6a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:51.165303 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-15d28471-1cf6-47e2-925f-2feee611db6a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:51.179630 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15d28471-1cf6-47e2-925f-2feee611db6a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:51.180041 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15d28471-1cf6-47e2-925f-2feee611db6a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:51.186211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15d28471-1cf6-47e2-925f-2feee611db6a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:51.186211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15d28471-1cf6-47e2-925f-2feee611db6a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:51.186211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15d28471-1cf6-47e2-925f-2feee611db6a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:51.186211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15d28471-1cf6-47e2-925f-2feee611db6a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:51.457118 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-15d28471-1cf6-47e2-925f-2feee611db6a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:51.470783 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-15d28471-1cf6-47e2-925f-2feee611db6a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1272 microversion: 2.1 time: 0.312908 Aug 24 08:55:51.472343 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 11/19] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:51 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1272 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:55:52.497438 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3eb22766-8dea-4373-8593-e31e685bb5ca tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:52.498063 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3eb22766-8dea-4373-8593-e31e685bb5ca tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:52.514058 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:52.516045 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3eb22766-8dea-4373-8593-e31e685bb5ca tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:52.520874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3eb22766-8dea-4373-8593-e31e685bb5ca tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:52.522111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3eb22766-8dea-4373-8593-e31e685bb5ca tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:52.523041 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3eb22766-8dea-4373-8593-e31e685bb5ca tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:52.523517 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3eb22766-8dea-4373-8593-e31e685bb5ca tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:52.523945 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3eb22766-8dea-4373-8593-e31e685bb5ca tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:52.605046 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Flavor limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:55:52.606398 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Image limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:55:52.607292 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Flavor pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:55:52.608988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Image pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:55:52.610301 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:55:52.639367 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:52.640294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:52.641017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:52.643825 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:52.647579 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:52.650909 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:52.735777 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Getting quotas for project c966c27f100846ca8cf06122ddc8c408. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:52.749342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Getting quotas for user f56524e822e641bc9bb11eddfe27f85d and project c966c27f100846ca8cf06122ddc8c408. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:52.803991 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Going to run 1 instances... {{(pid=132984) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:55:52.807136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3eb22766-8dea-4373-8593-e31e685bb5ca tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:52.812083 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:55:52.823282 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3eb22766-8dea-4373-8593-e31e685bb5ca tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1272 microversion: 2.1 time: 0.328118 Aug 24 08:55:52.834191 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 12/20] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:52 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1272 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:55:52.867508 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-569944876", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1dfbf550-bd95-483b-86a8-88a800c12481"}], "security_groups": [{"name": "tempest-securitygroup--314885006"}], "key_name": "tempest-keypair-518661313", "user_data": "}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:53.049289 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-dcce4db9-77b2-48b1-96dd-9f839a3028de tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.307142 Aug 24 08:55:53.066310 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 9/21] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 08:55:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 3324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:55:53.078892 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-37550034-2a72-484e-865a-01fa7c4b9155 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:53.081744 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-37550034-2a72-484e-865a-01fa7c4b9155 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:53.312294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-37550034-2a72-484e-865a-01fa7c4b9155 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:53.326933 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-37550034-2a72-484e-865a-01fa7c4b9155 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1222 microversion: 2.1 time: 0.255373 Aug 24 08:55:53.337488 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 10/22] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:53 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1222 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:53.792908 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.network.neutron [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] validate_networks() for [('1dfbf550-bd95-483b-86a8-88a800c12481', None, None, None, None, None)] {{(pid=132985) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:55:53.811229 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-588451394", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:53.990326 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.network.neutron [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] validate_networks() for [('1f91305e-a47a-4ee8-9410-ebf6faafeb89', None, None, None, None, None)] {{(pid=132984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:55:55.725675 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Flavor limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:55:55.726911 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Image limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:55:55.726911 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Flavor pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:55:55.727220 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Image pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:55:55.727362 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:55:55.777397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:55.786455 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:55.790399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:55.796132 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:55.799562 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:55.799562 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:55.870256 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Getting quotas for project c966c27f100846ca8cf06122ddc8c408. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:55.881032 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Getting quotas for user f56524e822e641bc9bb11eddfe27f85d and project c966c27f100846ca8cf06122ddc8c408. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:55.948303 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Going to run 1 instances... {{(pid=132984) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:55:55.950886 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:55:56.296529 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-84dcc564-4dd5-4bea-9a03-7f401b0765bc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.487942 Aug 24 08:55:56.310962 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 11/23] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 08:55:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:55:56.343505 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-320dbb41-9cfe-4f3c-9891-09a6be8ab3bc tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:56.347170 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-320dbb41-9cfe-4f3c-9891-09a6be8ab3bc tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:56.407245 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-320dbb41-9cfe-4f3c-9891-09a6be8ab3bc tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:56.409455 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-320dbb41-9cfe-4f3c-9891-09a6be8ab3bc tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:56.428863 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-320dbb41-9cfe-4f3c-9891-09a6be8ab3bc tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:56.430998 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-320dbb41-9cfe-4f3c-9891-09a6be8ab3bc tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:56.431337 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-320dbb41-9cfe-4f3c-9891-09a6be8ab3bc tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:56.431942 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-320dbb41-9cfe-4f3c-9891-09a6be8ab3bc tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:56.733871 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=16 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:57.185385 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-320dbb41-9cfe-4f3c-9891-09a6be8ab3bc tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:57.219008 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-320dbb41-9cfe-4f3c-9891-09a6be8ab3bc tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.905736 Aug 24 08:55:57.225049 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 12/24] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:56 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:57.268579 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b4fbea9e-72e6-4e60-8275-641df56562eb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:57.275243 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b4fbea9e-72e6-4e60-8275-641df56562eb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:57.577087 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Flavor limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:55:57.585830 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Image limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:55:57.585830 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Flavor pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:55:57.585830 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Image pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:55:57.585830 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:55:57.670053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:57.698279 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:57.721626 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:57.736712 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:57.741290 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:57.749565 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:57.765893 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b4fbea9e-72e6-4e60-8275-641df56562eb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:57.821866 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b4fbea9e-72e6-4e60-8275-641df56562eb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1221 microversion: 2.1 time: 0.591194 Aug 24 08:55:57.833211 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 13/25] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:57 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1221 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:57.868991 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Getting quotas for project 02d5c74d88a24eb9814f49a6ff4eca56. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:57.880185 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Getting quotas for user f5d7aee76519492e81b0048edebba36f and project 02d5c74d88a24eb9814f49a6ff4eca56. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:57.928587 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Going to run 1 instances... {{(pid=132985) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:55:57.931297 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:55:58.095530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1639962293", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce3c3cdc-b3eb-437a-9009-2b2f1c4b657c"}], "security_groups": [{"name": "tempest-securitygroup--415821116"}], "key_name": "tempest-keypair-1540102404", "user_data": "}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:58.234297 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8b2a5ef0-16b0-4710-a920-80f0fe0e37a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.398406 Aug 24 08:55:58.253191 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 13/26] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 08:55:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 5402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:55:58.265810 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a4f8c750-c6c0-4e9e-b6c1-8093153cbab1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:58.271249 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a4f8c750-c6c0-4e9e-b6c1-8093153cbab1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:58.505766 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.network.neutron [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] validate_networks() for [('ce3c3cdc-b3eb-437a-9009-2b2f1c4b657c', None, None, None, None, None)] {{(pid=132984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:55:58.627885 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a4f8c750-c6c0-4e9e-b6c1-8093153cbab1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:58.679560 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a4f8c750-c6c0-4e9e-b6c1-8093153cbab1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1236 microversion: 2.1 time: 0.422156 Aug 24 08:55:58.686195 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 14/27] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:58 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1236 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:58.731397 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cdf5ebce-3db2-491f-93c3-b4af6523c012 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:58.731397 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-cdf5ebce-3db2-491f-93c3-b4af6523c012 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:58.768482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cdf5ebce-3db2-491f-93c3-b4af6523c012 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:58.792621 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cdf5ebce-3db2-491f-93c3-b4af6523c012 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:58.795554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cdf5ebce-3db2-491f-93c3-b4af6523c012 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:58.806370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cdf5ebce-3db2-491f-93c3-b4af6523c012 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:58.806370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cdf5ebce-3db2-491f-93c3-b4af6523c012 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:58.806370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cdf5ebce-3db2-491f-93c3-b4af6523c012 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:59.523496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Flavor limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:55:59.524080 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Image limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:55:59.524723 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Flavor pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:55:59.525262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Image pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:55:59.525778 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:55:59.547231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:59.551843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:59.551843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:59.551843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:59.551843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:59.556913 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:59.646129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for project 3809ac47fe214dda92729d4c89648a17. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:59.662506 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for user 993697d33b7841668b1eabcdcd6b40f9 and project 3809ac47fe214dda92729d4c89648a17. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:59.701657 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Going to run 1 instances... {{(pid=132984) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:55:59.725738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:56:00.104346 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5c21546c-5776-4184-877d-09a0ea94cf37 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.032786 Aug 24 08:56:00.112523 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 14/28] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 08:55:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 2042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:56:00.120936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1f8ab823-8dcf-4972-a04c-5a69ac363116 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:00.123096 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1f8ab823-8dcf-4972-a04c-5a69ac363116 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:00.133258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1f8ab823-8dcf-4972-a04c-5a69ac363116 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:00.134107 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1f8ab823-8dcf-4972-a04c-5a69ac363116 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:00.136706 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1f8ab823-8dcf-4972-a04c-5a69ac363116 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:00.136706 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1f8ab823-8dcf-4972-a04c-5a69ac363116 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:00.136706 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1f8ab823-8dcf-4972-a04c-5a69ac363116 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:00.137686 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1f8ab823-8dcf-4972-a04c-5a69ac363116 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:00.332573 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-cdf5ebce-3db2-491f-93c3-b4af6523c012 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:00.366184 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-cdf5ebce-3db2-491f-93c3-b4af6523c012 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 1.663589 Aug 24 08:56:00.376578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 15/29] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:58 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:00.400653 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-36e63e13-5e0c-4aa7-b8ab-ee2b1c5dfccb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:00.411041 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-36e63e13-5e0c-4aa7-b8ab-ee2b1c5dfccb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:00.593546 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1f8ab823-8dcf-4972-a04c-5a69ac363116 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:00.622847 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1f8ab823-8dcf-4972-a04c-5a69ac363116 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1217 microversion: 2.1 time: 0.504086 Aug 24 08:56:00.628964 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 15/30] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:00 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1217 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:00.643792 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ee998129-aeb4-484f-ba9f-5ef62701e5aa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:00.648889 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ee998129-aeb4-484f-ba9f-5ef62701e5aa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:00.687983 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-36e63e13-5e0c-4aa7-b8ab-ee2b1c5dfccb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:00.702445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-36e63e13-5e0c-4aa7-b8ab-ee2b1c5dfccb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1236 microversion: 2.1 time: 0.319999 Aug 24 08:56:00.702445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 16/31] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:00 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1236 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:00.722961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1436410067", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe1af59a-c9c9-44db-b32e-f7711ec613c6"}], "security_groups": [{"name": "tempest-securitygroup--953673593"}], "key_name": "tempest-keypair-606371214", "user_data": "}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:00.946210 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ee998129-aeb4-484f-ba9f-5ef62701e5aa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:00.960625 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ee998129-aeb4-484f-ba9f-5ef62701e5aa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1242 microversion: 2.1 time: 0.332416 Aug 24 08:56:00.980508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 16/32] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:00 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1242 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:01.174679 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.network.neutron [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] validate_networks() for [('fe1af59a-c9c9-44db-b32e-f7711ec613c6', None, None, None, None, None)] {{(pid=132985) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:56:01.394349 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-00b7a791-68a8-42d5-a7a9-4bb092dbd9eb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:01.395881 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-00b7a791-68a8-42d5-a7a9-4bb092dbd9eb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:01.412388 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-00b7a791-68a8-42d5-a7a9-4bb092dbd9eb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:01.417103 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-00b7a791-68a8-42d5-a7a9-4bb092dbd9eb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:01.418411 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-00b7a791-68a8-42d5-a7a9-4bb092dbd9eb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:01.420029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-00b7a791-68a8-42d5-a7a9-4bb092dbd9eb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:01.421676 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-00b7a791-68a8-42d5-a7a9-4bb092dbd9eb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:01.423027 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-00b7a791-68a8-42d5-a7a9-4bb092dbd9eb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.391972 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-00b7a791-68a8-42d5-a7a9-4bb092dbd9eb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:02.416205 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-00b7a791-68a8-42d5-a7a9-4bb092dbd9eb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 1.025353 Aug 24 08:56:02.433485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 17/33] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:01 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:02.438685 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-252f2036-b98d-4af3-a1a8-01bad8738c72 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:02.439317 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-252f2036-b98d-4af3-a1a8-01bad8738c72 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:02.449076 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-252f2036-b98d-4af3-a1a8-01bad8738c72 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.449645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-252f2036-b98d-4af3-a1a8-01bad8738c72 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.450098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-252f2036-b98d-4af3-a1a8-01bad8738c72 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.450837 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-252f2036-b98d-4af3-a1a8-01bad8738c72 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.451616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-252f2036-b98d-4af3-a1a8-01bad8738c72 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.452483 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-252f2036-b98d-4af3-a1a8-01bad8738c72 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.462663 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Flavor limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:56:02.468055 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Image limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:56:02.468899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Flavor pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:56:02.469503 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Image pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:56:02.470248 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:56:02.484156 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.485106 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.487235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.488354 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.489072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.490793 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.522140 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Getting quotas for project a69447ca2f314084925442b7f8c9ee2e. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:56:02.530060 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Getting quotas for user 1105970982014891902ebbb9904a57a5 and project a69447ca2f314084925442b7f8c9ee2e. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:56:02.545974 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Going to run 1 instances... {{(pid=132985) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:56:02.550036 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:56:02.560670 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-252f2036-b98d-4af3-a1a8-01bad8738c72 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:02.583605 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-252f2036-b98d-4af3-a1a8-01bad8738c72 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1281 microversion: 2.1 time: 0.148828 Aug 24 08:56:02.587663 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 18/34] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:02 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:02.594199 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-50c9ea25-867c-4557-abaa-1472b2dbd12e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:02.595082 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-50c9ea25-867c-4557-abaa-1472b2dbd12e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:02.607002 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-50c9ea25-867c-4557-abaa-1472b2dbd12e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.608166 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-50c9ea25-867c-4557-abaa-1472b2dbd12e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.609339 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-50c9ea25-867c-4557-abaa-1472b2dbd12e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.610818 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-50c9ea25-867c-4557-abaa-1472b2dbd12e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.611648 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-50c9ea25-867c-4557-abaa-1472b2dbd12e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.612344 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-50c9ea25-867c-4557-abaa-1472b2dbd12e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.745873 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6eb6c680-d6ca-4aa2-b63e-642bb476ab44 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.045297 Aug 24 08:56:02.753360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 17/35] 10.222.0.55 () {62 vars in 1188 bytes} [Wed Aug 24 08:56:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 2049 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 08:56:02.763506 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5f2d9ea5-544c-4ac9-aea3-5ad3b3c986d2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:02.765355 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5f2d9ea5-544c-4ac9-aea3-5ad3b3c986d2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:02.775698 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:02.781187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f2d9ea5-544c-4ac9-aea3-5ad3b3c986d2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.782132 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f2d9ea5-544c-4ac9-aea3-5ad3b3c986d2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.782728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f2d9ea5-544c-4ac9-aea3-5ad3b3c986d2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.783771 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f2d9ea5-544c-4ac9-aea3-5ad3b3c986d2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.784395 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f2d9ea5-544c-4ac9-aea3-5ad3b3c986d2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.785418 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f2d9ea5-544c-4ac9-aea3-5ad3b3c986d2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.824968 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-50c9ea25-867c-4557-abaa-1472b2dbd12e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:02.835856 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-50c9ea25-867c-4557-abaa-1472b2dbd12e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1232 microversion: 2.1 time: 0.245874 Aug 24 08:56:02.837877 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 19/36] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:02 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1232 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:02.901608 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5f2d9ea5-544c-4ac9-aea3-5ad3b3c986d2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:02.917745 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5f2d9ea5-544c-4ac9-aea3-5ad3b3c986d2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1246 microversion: 2.1 time: 0.167141 Aug 24 08:56:02.918793 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 18/37] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:02 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1246 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:02.938322 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e58a62fe-2c32-4d57-98e9-7a7660b93f54 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:02.939895 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e58a62fe-2c32-4d57-98e9-7a7660b93f54 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:03.022345 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e58a62fe-2c32-4d57-98e9-7a7660b93f54 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:03.033799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e58a62fe-2c32-4d57-98e9-7a7660b93f54 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:03.037128 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e58a62fe-2c32-4d57-98e9-7a7660b93f54 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:03.039240 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e58a62fe-2c32-4d57-98e9-7a7660b93f54 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1281 microversion: 2.20 time: 0.108765 Aug 24 08:56:03.040487 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 19/38] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:02 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1281 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:03.255160 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-76e9f50c-2b44-42ac-97bb-a1e685ab27f9 req-eb92de1e-da73-4ea3-939e-bc41dc272e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd1ec0c9-cd4b-4256-bc67-975c8dc732c3", "tag": "6c0c24ef-4f56-4e8d-9dfc-db756eb87f1b"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:03.272091 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-76e9f50c-2b44-42ac-97bb-a1e685ab27f9 req-eb92de1e-da73-4ea3-939e-bc41dc272e69 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:03.272930 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-76e9f50c-2b44-42ac-97bb-a1e685ab27f9 req-eb92de1e-da73-4ea3-939e-bc41dc272e69 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:03.273509 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-76e9f50c-2b44-42ac-97bb-a1e685ab27f9 req-eb92de1e-da73-4ea3-939e-bc41dc272e69 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:03.305293 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-76e9f50c-2b44-42ac-97bb-a1e685ab27f9 req-eb92de1e-da73-4ea3-939e-bc41dc272e69 service nova] Creating event network-changed:6c0c24ef-4f56-4e8d-9dfc-db756eb87f1b for instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 on hv-cinder-85221 Aug 24 08:56:03.306467 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-76e9f50c-2b44-42ac-97bb-a1e685ab27f9 req-eb92de1e-da73-4ea3-939e-bc41dc272e69 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 08:56:03.307571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-76e9f50c-2b44-42ac-97bb-a1e685ab27f9 req-eb92de1e-da73-4ea3-939e-bc41dc272e69 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 08:56:03.310079 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8f9ba867-fdd0-4b66-ab78-07df7e984f0e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:03.312332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8f9ba867-fdd0-4b66-ab78-07df7e984f0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:03.312332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8f9ba867-fdd0-4b66-ab78-07df7e984f0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:03.316494 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8f9ba867-fdd0-4b66-ab78-07df7e984f0e None None] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:03.318266 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8f9ba867-fdd0-4b66-ab78-07df7e984f0e None None] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:03.319361 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8f9ba867-fdd0-4b66-ab78-07df7e984f0e None None] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:03.344017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.compute.rpcapi [None req-8f9ba867-fdd0-4b66-ab78-07df7e984f0e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 08:56:03.347002 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8f9ba867-fdd0-4b66-ab78-07df7e984f0e None None] Releasing lock "compute-rpcapi-router" {{(pid=132984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 08:56:03.382628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8f9ba867-fdd0-4b66-ab78-07df7e984f0e None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.542343 Aug 24 08:56:03.382628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 20/39] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:03.440051 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-29e0ba80-8bd0-4e1f-b038-fd319d5e9e09 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:03.440794 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-29e0ba80-8bd0-4e1f-b038-fd319d5e9e09 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:03.454518 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29e0ba80-8bd0-4e1f-b038-fd319d5e9e09 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:03.455032 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29e0ba80-8bd0-4e1f-b038-fd319d5e9e09 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:03.455476 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29e0ba80-8bd0-4e1f-b038-fd319d5e9e09 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:03.456193 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29e0ba80-8bd0-4e1f-b038-fd319d5e9e09 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:03.456680 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29e0ba80-8bd0-4e1f-b038-fd319d5e9e09 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:03.457112 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29e0ba80-8bd0-4e1f-b038-fd319d5e9e09 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:03.613428 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fb05c921-672f-4984-9b3f-88cd84f78e68 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:03.617433 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fb05c921-672f-4984-9b3f-88cd84f78e68 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:03.631902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fb05c921-672f-4984-9b3f-88cd84f78e68 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:03.633528 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fb05c921-672f-4984-9b3f-88cd84f78e68 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:03.637340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fb05c921-672f-4984-9b3f-88cd84f78e68 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:03.637340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fb05c921-672f-4984-9b3f-88cd84f78e68 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:03.639254 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fb05c921-672f-4984-9b3f-88cd84f78e68 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:03.640677 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fb05c921-672f-4984-9b3f-88cd84f78e68 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:03.699472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-29e0ba80-8bd0-4e1f-b038-fd319d5e9e09 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:03.731125 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-29e0ba80-8bd0-4e1f-b038-fd319d5e9e09 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.291926 Aug 24 08:56:03.745319 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 20/40] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:03 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:03.835025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fb05c921-672f-4984-9b3f-88cd84f78e68 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:03.858903 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-05d0f912-f872-4db3-a8ba-e0aa52916fe2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:03.859735 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-05d0f912-f872-4db3-a8ba-e0aa52916fe2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:03.865457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fb05c921-672f-4984-9b3f-88cd84f78e68 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1281 microversion: 2.1 time: 0.258589 Aug 24 08:56:03.867167 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05d0f912-f872-4db3-a8ba-e0aa52916fe2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:03.867364 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 21/41] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:03 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1281 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:03.868231 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05d0f912-f872-4db3-a8ba-e0aa52916fe2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:03.869141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05d0f912-f872-4db3-a8ba-e0aa52916fe2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:03.870156 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05d0f912-f872-4db3-a8ba-e0aa52916fe2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:03.870863 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05d0f912-f872-4db3-a8ba-e0aa52916fe2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:03.871580 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05d0f912-f872-4db3-a8ba-e0aa52916fe2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:03.944253 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-96368262-0758-435c-8790-ea3df17edc1e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:03.945023 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-96368262-0758-435c-8790-ea3df17edc1e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:03.949038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:03.953353 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96368262-0758-435c-8790-ea3df17edc1e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:03.957271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96368262-0758-435c-8790-ea3df17edc1e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:03.957271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96368262-0758-435c-8790-ea3df17edc1e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:03.957271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96368262-0758-435c-8790-ea3df17edc1e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:03.957271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96368262-0758-435c-8790-ea3df17edc1e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:03.957651 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96368262-0758-435c-8790-ea3df17edc1e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:03.993085 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-05d0f912-f872-4db3-a8ba-e0aa52916fe2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:04.026079 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-05d0f912-f872-4db3-a8ba-e0aa52916fe2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1232 microversion: 2.1 time: 0.171302 Aug 24 08:56:04.030468 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 21/42] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:03 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1232 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:04.070478 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ba743c89-0237-465c-8914-c6b956b12b82 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:04.078683 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ba743c89-0237-465c-8914-c6b956b12b82 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:04.078781 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-96368262-0758-435c-8790-ea3df17edc1e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:04.089034 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-96368262-0758-435c-8790-ea3df17edc1e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1246 microversion: 2.1 time: 0.150199 Aug 24 08:56:04.106507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 22/43] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:03 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1246 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:04.248245 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ba743c89-0237-465c-8914-c6b956b12b82 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:04.261103 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ba743c89-0237-465c-8914-c6b956b12b82 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:04.263574 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ba743c89-0237-465c-8914-c6b956b12b82 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:04.267438 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ba743c89-0237-465c-8914-c6b956b12b82 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1281 microversion: 2.20 time: 0.202591 Aug 24 08:56:04.267438 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 22/44] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:04 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1281 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:04.766924 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-169c8888-07b9-4dc0-b198-630b4fbd7287 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:04.777638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-169c8888-07b9-4dc0-b198-630b4fbd7287 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:04.777638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-169c8888-07b9-4dc0-b198-630b4fbd7287 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:04.777638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-169c8888-07b9-4dc0-b198-630b4fbd7287 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:04.777638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-169c8888-07b9-4dc0-b198-630b4fbd7287 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:04.778830 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-169c8888-07b9-4dc0-b198-630b4fbd7287 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:04.778830 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-169c8888-07b9-4dc0-b198-630b4fbd7287 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:04.778830 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-169c8888-07b9-4dc0-b198-630b4fbd7287 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:04.890255 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8f1ab226-f595-4263-a5f1-150cfdacc5b9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:04.891431 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8f1ab226-f595-4263-a5f1-150cfdacc5b9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:04.926493 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f1ab226-f595-4263-a5f1-150cfdacc5b9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:04.927834 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f1ab226-f595-4263-a5f1-150cfdacc5b9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:04.933215 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f1ab226-f595-4263-a5f1-150cfdacc5b9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:04.935961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f1ab226-f595-4263-a5f1-150cfdacc5b9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:04.942221 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f1ab226-f595-4263-a5f1-150cfdacc5b9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:04.945438 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f1ab226-f595-4263-a5f1-150cfdacc5b9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:04.960912 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-169c8888-07b9-4dc0-b198-630b4fbd7287 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:04.970836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-169c8888-07b9-4dc0-b198-630b4fbd7287 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.209431 Aug 24 08:56:04.971695 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 23/45] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:04 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:05.051636 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f39c4d21-a089-470c-b516-6000b1a33bb3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:05.052381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f39c4d21-a089-470c-b516-6000b1a33bb3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:05.059997 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f39c4d21-a089-470c-b516-6000b1a33bb3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:05.060588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f39c4d21-a089-470c-b516-6000b1a33bb3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:05.061035 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f39c4d21-a089-470c-b516-6000b1a33bb3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:05.063049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8f1ab226-f595-4263-a5f1-150cfdacc5b9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:05.063237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f39c4d21-a089-470c-b516-6000b1a33bb3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:05.063237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f39c4d21-a089-470c-b516-6000b1a33bb3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:05.063237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f39c4d21-a089-470c-b516-6000b1a33bb3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:05.072909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8f1ab226-f595-4263-a5f1-150cfdacc5b9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1281 microversion: 2.1 time: 0.188955 Aug 24 08:56:05.073754 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 23/46] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:04 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:05.123000 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-31a611dc-6a38-45f5-bf4d-7de9832e7fdb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:05.124282 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-31a611dc-6a38-45f5-bf4d-7de9832e7fdb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:05.139759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31a611dc-6a38-45f5-bf4d-7de9832e7fdb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:05.140804 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31a611dc-6a38-45f5-bf4d-7de9832e7fdb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:05.141763 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31a611dc-6a38-45f5-bf4d-7de9832e7fdb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:05.143302 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31a611dc-6a38-45f5-bf4d-7de9832e7fdb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:05.145191 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31a611dc-6a38-45f5-bf4d-7de9832e7fdb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:05.147644 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31a611dc-6a38-45f5-bf4d-7de9832e7fdb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:05.194730 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f39c4d21-a089-470c-b516-6000b1a33bb3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:05.246450 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f39c4d21-a089-470c-b516-6000b1a33bb3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1232 microversion: 2.1 time: 0.199064 Aug 24 08:56:05.252436 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 24/47] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:05 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1232 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:05.315412 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ec1c67fa-2b1a-40da-91df-18cb2e25fb97 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:05.316532 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ec1c67fa-2b1a-40da-91df-18cb2e25fb97 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:05.332628 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-31a611dc-6a38-45f5-bf4d-7de9832e7fdb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:05.349691 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-31a611dc-6a38-45f5-bf4d-7de9832e7fdb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1246 microversion: 2.1 time: 0.232548 Aug 24 08:56:05.349691 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 24/48] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:05 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1246 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:05.355680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec1c67fa-2b1a-40da-91df-18cb2e25fb97 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:05.356588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec1c67fa-2b1a-40da-91df-18cb2e25fb97 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:05.357364 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec1c67fa-2b1a-40da-91df-18cb2e25fb97 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:05.358620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec1c67fa-2b1a-40da-91df-18cb2e25fb97 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:05.359454 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec1c67fa-2b1a-40da-91df-18cb2e25fb97 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:05.360191 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec1c67fa-2b1a-40da-91df-18cb2e25fb97 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:05.698742 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ec1c67fa-2b1a-40da-91df-18cb2e25fb97 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:05.716660 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ec1c67fa-2b1a-40da-91df-18cb2e25fb97 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:05.719892 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ec1c67fa-2b1a-40da-91df-18cb2e25fb97 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:05.722130 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ec1c67fa-2b1a-40da-91df-18cb2e25fb97 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1285 microversion: 2.20 time: 0.420385 Aug 24 08:56:05.723435 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 25/49] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:05 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1285 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:06.008707 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e23941f3-58f6-46eb-8383-eb1286bba487 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:06.010180 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e23941f3-58f6-46eb-8383-eb1286bba487 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:06.019662 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e23941f3-58f6-46eb-8383-eb1286bba487 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:06.022393 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e23941f3-58f6-46eb-8383-eb1286bba487 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:06.023960 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e23941f3-58f6-46eb-8383-eb1286bba487 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:06.026330 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e23941f3-58f6-46eb-8383-eb1286bba487 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:06.027673 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e23941f3-58f6-46eb-8383-eb1286bba487 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:06.029039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e23941f3-58f6-46eb-8383-eb1286bba487 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:06.110465 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-62f929ef-1478-4e18-9290-a2ae52082c85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:06.112193 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-62f929ef-1478-4e18-9290-a2ae52082c85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:06.129310 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62f929ef-1478-4e18-9290-a2ae52082c85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:06.132672 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62f929ef-1478-4e18-9290-a2ae52082c85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:06.133604 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62f929ef-1478-4e18-9290-a2ae52082c85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:06.135789 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62f929ef-1478-4e18-9290-a2ae52082c85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:06.138073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62f929ef-1478-4e18-9290-a2ae52082c85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:06.138867 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62f929ef-1478-4e18-9290-a2ae52082c85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:06.340337 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e23941f3-58f6-46eb-8383-eb1286bba487 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:06.345494 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-62f929ef-1478-4e18-9290-a2ae52082c85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:06.350536 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e23941f3-58f6-46eb-8383-eb1286bba487 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.346849 Aug 24 08:56:06.351183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 25/50] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:06 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:06.356558 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-96473da5-4456-4551-9f96-37de04c548f7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:06.357264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-96473da5-4456-4551-9f96-37de04c548f7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:06.365108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-96473da5-4456-4551-9f96-37de04c548f7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:06.365622 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-96473da5-4456-4551-9f96-37de04c548f7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:06.366059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-96473da5-4456-4551-9f96-37de04c548f7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:06.366772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-96473da5-4456-4551-9f96-37de04c548f7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:06.367577 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-96473da5-4456-4551-9f96-37de04c548f7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:06.368162 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-96473da5-4456-4551-9f96-37de04c548f7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:06.379673 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-62f929ef-1478-4e18-9290-a2ae52082c85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1281 microversion: 2.1 time: 0.274001 Aug 24 08:56:06.381893 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 26/51] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:06 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1281 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:06.392981 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d1e8c99d-4cd3-43af-8e3a-e78f50f3e987 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:06.394519 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d1e8c99d-4cd3-43af-8e3a-e78f50f3e987 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:06.410260 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d1e8c99d-4cd3-43af-8e3a-e78f50f3e987 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:06.412020 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d1e8c99d-4cd3-43af-8e3a-e78f50f3e987 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:06.413044 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d1e8c99d-4cd3-43af-8e3a-e78f50f3e987 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:06.414578 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d1e8c99d-4cd3-43af-8e3a-e78f50f3e987 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:06.415600 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d1e8c99d-4cd3-43af-8e3a-e78f50f3e987 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:06.416464 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d1e8c99d-4cd3-43af-8e3a-e78f50f3e987 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:06.478342 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-96473da5-4456-4551-9f96-37de04c548f7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:06.487493 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-96473da5-4456-4551-9f96-37de04c548f7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1232 microversion: 2.1 time: 0.134930 Aug 24 08:56:06.500972 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 26/52] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:06 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1232 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:06.561988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d1e8c99d-4cd3-43af-8e3a-e78f50f3e987 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:06.578003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d1e8c99d-4cd3-43af-8e3a-e78f50f3e987 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1246 microversion: 2.1 time: 0.193905 Aug 24 08:56:06.578938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 27/53] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:06 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1246 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:06.795262 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0114a738-6c2a-40c6-9f4c-f367908e0463 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:06.796787 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0114a738-6c2a-40c6-9f4c-f367908e0463 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:06.830252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0114a738-6c2a-40c6-9f4c-f367908e0463 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:06.832812 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0114a738-6c2a-40c6-9f4c-f367908e0463 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:06.835832 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0114a738-6c2a-40c6-9f4c-f367908e0463 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:06.841575 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0114a738-6c2a-40c6-9f4c-f367908e0463 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:06.846109 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0114a738-6c2a-40c6-9f4c-f367908e0463 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:06.849385 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0114a738-6c2a-40c6-9f4c-f367908e0463 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:07.199808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0114a738-6c2a-40c6-9f4c-f367908e0463 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:07.220920 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0114a738-6c2a-40c6-9f4c-f367908e0463 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:07.228122 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0114a738-6c2a-40c6-9f4c-f367908e0463 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:07.229404 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0114a738-6c2a-40c6-9f4c-f367908e0463 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1285 microversion: 2.20 time: 0.462545 Aug 24 08:56:07.233846 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 27/54] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:06 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1285 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:07.389215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-34c7eaa0-cba1-4378-b99d-3050b89346a5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:07.389592 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-34c7eaa0-cba1-4378-b99d-3050b89346a5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:07.409836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-34c7eaa0-cba1-4378-b99d-3050b89346a5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:07.409836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-34c7eaa0-cba1-4378-b99d-3050b89346a5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:07.409836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-34c7eaa0-cba1-4378-b99d-3050b89346a5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:07.410182 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ac0f317e-6908-42e3-9aa2-262a72c349ef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:07.410265 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-34c7eaa0-cba1-4378-b99d-3050b89346a5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:07.410340 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ac0f317e-6908-42e3-9aa2-262a72c349ef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:07.410484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-34c7eaa0-cba1-4378-b99d-3050b89346a5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:07.416314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac0f317e-6908-42e3-9aa2-262a72c349ef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:07.418532 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac0f317e-6908-42e3-9aa2-262a72c349ef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:07.419028 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac0f317e-6908-42e3-9aa2-262a72c349ef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:07.419771 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac0f317e-6908-42e3-9aa2-262a72c349ef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:07.420235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac0f317e-6908-42e3-9aa2-262a72c349ef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:07.428437 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-34c7eaa0-cba1-4378-b99d-3050b89346a5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:07.428801 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac0f317e-6908-42e3-9aa2-262a72c349ef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:07.683601 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ac0f317e-6908-42e3-9aa2-262a72c349ef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:07.712631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ac0f317e-6908-42e3-9aa2-262a72c349ef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1279 microversion: 2.1 time: 0.305119 Aug 24 08:56:07.740990 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 28/55] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:07 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1279 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:07.767445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d4244bc3-7c72-40f5-94ea-6cb0af070f53 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:07.772252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d4244bc3-7c72-40f5-94ea-6cb0af070f53 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:07.839969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d4244bc3-7c72-40f5-94ea-6cb0af070f53 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:07.854035 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d4244bc3-7c72-40f5-94ea-6cb0af070f53 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:07.861506 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d4244bc3-7c72-40f5-94ea-6cb0af070f53 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:07.873301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d4244bc3-7c72-40f5-94ea-6cb0af070f53 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:07.874623 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d4244bc3-7c72-40f5-94ea-6cb0af070f53 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:07.880738 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d4244bc3-7c72-40f5-94ea-6cb0af070f53 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:08.240718 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d4244bc3-7c72-40f5-94ea-6cb0af070f53 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:08.273998 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d4244bc3-7c72-40f5-94ea-6cb0af070f53 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1288 microversion: 2.1 time: 0.531251 Aug 24 08:56:08.284117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 29/56] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:07 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1288 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:08.304069 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-efb04c39-5f07-4aed-85bd-134538561ab8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:08.306348 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-efb04c39-5f07-4aed-85bd-134538561ab8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:08.318297 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efb04c39-5f07-4aed-85bd-134538561ab8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:08.319078 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efb04c39-5f07-4aed-85bd-134538561ab8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:08.319879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efb04c39-5f07-4aed-85bd-134538561ab8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:08.321088 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efb04c39-5f07-4aed-85bd-134538561ab8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:08.322368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efb04c39-5f07-4aed-85bd-134538561ab8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:08.324441 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efb04c39-5f07-4aed-85bd-134538561ab8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:08.354438 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:08.428852 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-efb04c39-5f07-4aed-85bd-134538561ab8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:08.439560 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-efb04c39-5f07-4aed-85bd-134538561ab8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1238 microversion: 2.1 time: 0.150983 Aug 24 08:56:08.441595 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 30/57] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:08 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1238 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:08.448163 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-56c25b42-750c-4697-b8e3-051efa5baffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:08.449227 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-56c25b42-750c-4697-b8e3-051efa5baffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:08.466777 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-56c25b42-750c-4697-b8e3-051efa5baffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:08.467553 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-56c25b42-750c-4697-b8e3-051efa5baffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:08.467986 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-56c25b42-750c-4697-b8e3-051efa5baffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:08.469094 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-56c25b42-750c-4697-b8e3-051efa5baffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:08.469709 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-56c25b42-750c-4697-b8e3-051efa5baffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:08.470313 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-56c25b42-750c-4697-b8e3-051efa5baffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:08.576112 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-56c25b42-750c-4697-b8e3-051efa5baffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:08.585980 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-56c25b42-750c-4697-b8e3-051efa5baffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:08.588063 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-56c25b42-750c-4697-b8e3-051efa5baffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:08.589526 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-56c25b42-750c-4697-b8e3-051efa5baffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1333 microversion: 2.20 time: 0.145873 Aug 24 08:56:08.590718 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 31/58] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:08 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1333 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:08.770287 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f91cc162-f7c4-4438-8f21-de44446f2d7d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:08.772278 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f91cc162-f7c4-4438-8f21-de44446f2d7d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:08.779679 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f91cc162-f7c4-4438-8f21-de44446f2d7d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:08.782673 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f91cc162-f7c4-4438-8f21-de44446f2d7d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:08.783289 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f91cc162-f7c4-4438-8f21-de44446f2d7d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:08.787369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f91cc162-f7c4-4438-8f21-de44446f2d7d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:08.787369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f91cc162-f7c4-4438-8f21-de44446f2d7d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:08.787369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f91cc162-f7c4-4438-8f21-de44446f2d7d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:08.842045 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-34c7eaa0-cba1-4378-b99d-3050b89346a5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:08.875171 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-34c7eaa0-cba1-4378-b99d-3050b89346a5 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 1.488641 Aug 24 08:56:08.884027 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 28/59] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:07 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:09.028223 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f91cc162-f7c4-4438-8f21-de44446f2d7d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:09.045408 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f91cc162-f7c4-4438-8f21-de44446f2d7d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1279 microversion: 2.1 time: 0.291911 Aug 24 08:56:09.046002 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 32/60] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:08 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1279 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:09.308229 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a9dcf493-d65c-45d1-9682-2fe96e7256d4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:09.315590 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a9dcf493-d65c-45d1-9682-2fe96e7256d4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:09.364908 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9dcf493-d65c-45d1-9682-2fe96e7256d4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:09.369700 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9dcf493-d65c-45d1-9682-2fe96e7256d4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:09.370507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9dcf493-d65c-45d1-9682-2fe96e7256d4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:09.371891 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9dcf493-d65c-45d1-9682-2fe96e7256d4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:09.386395 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9dcf493-d65c-45d1-9682-2fe96e7256d4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:09.389110 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9dcf493-d65c-45d1-9682-2fe96e7256d4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:09.491073 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2d84d463-672d-47e4-9fa0-46c3f3862e65 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:09.491930 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2d84d463-672d-47e4-9fa0-46c3f3862e65 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:09.513825 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2d84d463-672d-47e4-9fa0-46c3f3862e65 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:09.514381 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2d84d463-672d-47e4-9fa0-46c3f3862e65 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:09.514889 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2d84d463-672d-47e4-9fa0-46c3f3862e65 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:09.525339 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2d84d463-672d-47e4-9fa0-46c3f3862e65 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:09.525857 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2d84d463-672d-47e4-9fa0-46c3f3862e65 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:09.526307 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2d84d463-672d-47e4-9fa0-46c3f3862e65 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:10.010021 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2d84d463-672d-47e4-9fa0-46c3f3862e65 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:10.026103 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2d84d463-672d-47e4-9fa0-46c3f3862e65 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1294 microversion: 2.1 time: 0.540642 Aug 24 08:56:10.041004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 33/61] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:09 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1294 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:10.046915 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-29e772c4-d693-46ee-9118-5f9e319de0e9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:10.047940 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-29e772c4-d693-46ee-9118-5f9e319de0e9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:10.056606 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29e772c4-d693-46ee-9118-5f9e319de0e9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:10.057510 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29e772c4-d693-46ee-9118-5f9e319de0e9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:10.062941 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29e772c4-d693-46ee-9118-5f9e319de0e9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:10.062941 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29e772c4-d693-46ee-9118-5f9e319de0e9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:10.062941 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29e772c4-d693-46ee-9118-5f9e319de0e9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:10.062941 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29e772c4-d693-46ee-9118-5f9e319de0e9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:10.298912 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a9dcf493-d65c-45d1-9682-2fe96e7256d4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:10.304499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:10.312422 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a9dcf493-d65c-45d1-9682-2fe96e7256d4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1306 microversion: 2.1 time: 1.012024 Aug 24 08:56:10.313843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 29/62] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:09 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1306 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:10.319822 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-005d7122-f493-43ca-beb7-ec04563d47a6 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:10.320882 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-005d7122-f493-43ca-beb7-ec04563d47a6 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:10.372795 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-005d7122-f493-43ca-beb7-ec04563d47a6 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:10.373787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-005d7122-f493-43ca-beb7-ec04563d47a6 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:10.375666 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-005d7122-f493-43ca-beb7-ec04563d47a6 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:10.378455 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-005d7122-f493-43ca-beb7-ec04563d47a6 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:10.380976 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-005d7122-f493-43ca-beb7-ec04563d47a6 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:10.382862 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-005d7122-f493-43ca-beb7-ec04563d47a6 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:10.827626 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-005d7122-f493-43ca-beb7-ec04563d47a6 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:10.848528 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-005d7122-f493-43ca-beb7-ec04563d47a6 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.533185 Aug 24 08:56:10.849334 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 30/63] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:10 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:10.861373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d9f67cfa-8a0b-444f-9974-8d5cc237d7d6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:10.862028 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d9f67cfa-8a0b-444f-9974-8d5cc237d7d6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:10.883047 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d9f67cfa-8a0b-444f-9974-8d5cc237d7d6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:10.883830 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d9f67cfa-8a0b-444f-9974-8d5cc237d7d6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:10.884653 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d9f67cfa-8a0b-444f-9974-8d5cc237d7d6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:10.891940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d9f67cfa-8a0b-444f-9974-8d5cc237d7d6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:10.893041 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d9f67cfa-8a0b-444f-9974-8d5cc237d7d6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:10.893497 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d9f67cfa-8a0b-444f-9974-8d5cc237d7d6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:10.958723 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=32 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:11.048849 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d9f67cfa-8a0b-444f-9974-8d5cc237d7d6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:11.060966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d9f67cfa-8a0b-444f-9974-8d5cc237d7d6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1279 microversion: 2.1 time: 0.210562 Aug 24 08:56:11.064872 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 31/64] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:10 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1279 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:11.079524 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6a457e41-219b-4c74-842a-8f4437e28538 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:11.081690 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6a457e41-219b-4c74-842a-8f4437e28538 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:11.087352 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-29e772c4-d693-46ee-9118-5f9e319de0e9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:11.100040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6a457e41-219b-4c74-842a-8f4437e28538 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:11.101430 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6a457e41-219b-4c74-842a-8f4437e28538 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:11.102033 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6a457e41-219b-4c74-842a-8f4437e28538 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:11.102967 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6a457e41-219b-4c74-842a-8f4437e28538 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:11.113129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6a457e41-219b-4c74-842a-8f4437e28538 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:11.114980 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6a457e41-219b-4c74-842a-8f4437e28538 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:11.118288 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-29e772c4-d693-46ee-9118-5f9e319de0e9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:11.124848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-29e772c4-d693-46ee-9118-5f9e319de0e9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:11.134520 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-29e772c4-d693-46ee-9118-5f9e319de0e9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1351 microversion: 2.20 time: 1.091510 Aug 24 08:56:11.149611 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 34/65] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:10 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1351 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:11.363098 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3c7f554a-3b14-4d8d-ae27-8dcb2f1714d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:11.364049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3c7f554a-3b14-4d8d-ae27-8dcb2f1714d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:11.376898 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3c7f554a-3b14-4d8d-ae27-8dcb2f1714d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:11.377671 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3c7f554a-3b14-4d8d-ae27-8dcb2f1714d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:11.378495 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3c7f554a-3b14-4d8d-ae27-8dcb2f1714d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:11.379563 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3c7f554a-3b14-4d8d-ae27-8dcb2f1714d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:11.380414 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3c7f554a-3b14-4d8d-ae27-8dcb2f1714d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:11.381879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3c7f554a-3b14-4d8d-ae27-8dcb2f1714d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:11.406515 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6a457e41-219b-4c74-842a-8f4437e28538 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:11.441539 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6a457e41-219b-4c74-842a-8f4437e28538 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1312 microversion: 2.1 time: 0.363324 Aug 24 08:56:11.451412 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 32/66] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:11 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1312 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:11.677699 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3c7f554a-3b14-4d8d-ae27-8dcb2f1714d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:11.700104 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3c7f554a-3b14-4d8d-ae27-8dcb2f1714d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1294 microversion: 2.1 time: 0.347521 Aug 24 08:56:11.704620 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 35/67] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:11 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1294 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:11.767269 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-c4635f8b-eef7-431b-be28-55b305bd449f req-d229a110-a224-4ea2-ae05-bc40351ef213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e80c6c-b61f-42b6-9c29-cf86c7099e57", "tag": "08f182dc-1537-4524-ac71-00ff617d64ef"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:11.779628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-c4635f8b-eef7-431b-be28-55b305bd449f req-d229a110-a224-4ea2-ae05-bc40351ef213 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:11.780132 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-c4635f8b-eef7-431b-be28-55b305bd449f req-d229a110-a224-4ea2-ae05-bc40351ef213 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:11.780588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-c4635f8b-eef7-431b-be28-55b305bd449f req-d229a110-a224-4ea2-ae05-bc40351ef213 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:11.792477 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-c4635f8b-eef7-431b-be28-55b305bd449f req-d229a110-a224-4ea2-ae05-bc40351ef213 service nova] Creating event network-changed:08f182dc-1537-4524-ac71-00ff617d64ef for instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 on hv-cinder-85221 Aug 24 08:56:11.797938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-c4635f8b-eef7-431b-be28-55b305bd449f req-d229a110-a224-4ea2-ae05-bc40351ef213 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130996 Aug 24 08:56:11.798542 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 33/68] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:56:11.903510 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c993543b-59e2-40e8-85bf-111873cd610a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:11.904113 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c993543b-59e2-40e8-85bf-111873cd610a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:11.917601 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c993543b-59e2-40e8-85bf-111873cd610a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:11.918112 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c993543b-59e2-40e8-85bf-111873cd610a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:11.918703 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c993543b-59e2-40e8-85bf-111873cd610a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:11.919230 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c993543b-59e2-40e8-85bf-111873cd610a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:11.919679 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c993543b-59e2-40e8-85bf-111873cd610a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:11.920096 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c993543b-59e2-40e8-85bf-111873cd610a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.099602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-404e80fc-276b-46b4-bca3-2ec6bbe87cf2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:12.100962 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-404e80fc-276b-46b4-bca3-2ec6bbe87cf2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:12.109588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-404e80fc-276b-46b4-bca3-2ec6bbe87cf2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.110381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-404e80fc-276b-46b4-bca3-2ec6bbe87cf2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.111276 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-404e80fc-276b-46b4-bca3-2ec6bbe87cf2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.112773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-404e80fc-276b-46b4-bca3-2ec6bbe87cf2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.113710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-404e80fc-276b-46b4-bca3-2ec6bbe87cf2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.114406 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-404e80fc-276b-46b4-bca3-2ec6bbe87cf2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.129248 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c993543b-59e2-40e8-85bf-111873cd610a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:12.148466 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c993543b-59e2-40e8-85bf-111873cd610a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.248971 Aug 24 08:56:12.149865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 36/69] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:11 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:12.195080 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-01694a85-b117-4265-8b12-bda54f52e4d1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:12.196162 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-01694a85-b117-4265-8b12-bda54f52e4d1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:12.206545 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-01694a85-b117-4265-8b12-bda54f52e4d1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.207253 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-01694a85-b117-4265-8b12-bda54f52e4d1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.208686 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-01694a85-b117-4265-8b12-bda54f52e4d1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.210055 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-01694a85-b117-4265-8b12-bda54f52e4d1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.210535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-01694a85-b117-4265-8b12-bda54f52e4d1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.211082 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-01694a85-b117-4265-8b12-bda54f52e4d1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.322590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-01694a85-b117-4265-8b12-bda54f52e4d1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:12.336475 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-01694a85-b117-4265-8b12-bda54f52e4d1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:12.338538 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-01694a85-b117-4265-8b12-bda54f52e4d1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:12.339799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-01694a85-b117-4265-8b12-bda54f52e4d1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1339 microversion: 2.20 time: 0.156579 Aug 24 08:56:12.340684 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 37/70] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:12 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1339 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:12.384006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-404e80fc-276b-46b4-bca3-2ec6bbe87cf2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:12.399163 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-404e80fc-276b-46b4-bca3-2ec6bbe87cf2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.307381 Aug 24 08:56:12.400258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 34/71] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:12 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:12.496202 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-dc48367e-5436-48ce-b30e-1890ef5a7fb2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:12.498990 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-dc48367e-5436-48ce-b30e-1890ef5a7fb2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:12.506082 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=4 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:12.515254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc48367e-5436-48ce-b30e-1890ef5a7fb2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.516101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc48367e-5436-48ce-b30e-1890ef5a7fb2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.517729 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc48367e-5436-48ce-b30e-1890ef5a7fb2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.518572 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc48367e-5436-48ce-b30e-1890ef5a7fb2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.519843 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc48367e-5436-48ce-b30e-1890ef5a7fb2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.520243 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc48367e-5436-48ce-b30e-1890ef5a7fb2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.634833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-dc48367e-5436-48ce-b30e-1890ef5a7fb2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:12.647799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-dc48367e-5436-48ce-b30e-1890ef5a7fb2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1300 microversion: 2.1 time: 0.157251 Aug 24 08:56:12.648634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 38/72] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:12 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1300 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:12.722378 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9945d5e7-3d95-4944-b98a-b63f07b28162 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:12.723038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9945d5e7-3d95-4944-b98a-b63f07b28162 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:12.729943 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9945d5e7-3d95-4944-b98a-b63f07b28162 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.730490 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9945d5e7-3d95-4944-b98a-b63f07b28162 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.731054 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9945d5e7-3d95-4944-b98a-b63f07b28162 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.732030 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9945d5e7-3d95-4944-b98a-b63f07b28162 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.733499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9945d5e7-3d95-4944-b98a-b63f07b28162 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.733499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9945d5e7-3d95-4944-b98a-b63f07b28162 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.803515 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9945d5e7-3d95-4944-b98a-b63f07b28162 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:12.812436 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9945d5e7-3d95-4944-b98a-b63f07b28162 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1294 microversion: 2.1 time: 0.094217 Aug 24 08:56:12.824809 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 35/73] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:12 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:13.183204 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cd6e60f7-f04e-4898-bd36-5fc415cb2db1 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:13.183985 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-cd6e60f7-f04e-4898-bd36-5fc415cb2db1 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:13.193209 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cd6e60f7-f04e-4898-bd36-5fc415cb2db1 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:13.193702 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cd6e60f7-f04e-4898-bd36-5fc415cb2db1 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:13.194397 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cd6e60f7-f04e-4898-bd36-5fc415cb2db1 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:13.195503 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cd6e60f7-f04e-4898-bd36-5fc415cb2db1 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:13.196216 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cd6e60f7-f04e-4898-bd36-5fc415cb2db1 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:13.196916 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cd6e60f7-f04e-4898-bd36-5fc415cb2db1 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:13.363530 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-cd6e60f7-f04e-4898-bd36-5fc415cb2db1 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:13.372577 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-cd6e60f7-f04e-4898-bd36-5fc415cb2db1 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.193714 Aug 24 08:56:13.373137 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 39/74] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:13 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:13.381677 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6d6cea88-0f4c-4dda-afc7-25c84943aeb2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:13.382863 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6d6cea88-0f4c-4dda-afc7-25c84943aeb2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:13.386449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=8 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:13.395730 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6d6cea88-0f4c-4dda-afc7-25c84943aeb2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:13.396679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6d6cea88-0f4c-4dda-afc7-25c84943aeb2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:13.397460 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6d6cea88-0f4c-4dda-afc7-25c84943aeb2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:13.398280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6d6cea88-0f4c-4dda-afc7-25c84943aeb2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:13.398815 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6d6cea88-0f4c-4dda-afc7-25c84943aeb2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:13.399280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6d6cea88-0f4c-4dda-afc7-25c84943aeb2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:13.423616 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e49af690-a77a-416c-8c95-0c97a07d2da6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:13.424681 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e49af690-a77a-416c-8c95-0c97a07d2da6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:13.432328 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e49af690-a77a-416c-8c95-0c97a07d2da6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:13.432919 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e49af690-a77a-416c-8c95-0c97a07d2da6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:13.433378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e49af690-a77a-416c-8c95-0c97a07d2da6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:13.434066 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e49af690-a77a-416c-8c95-0c97a07d2da6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:13.434513 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e49af690-a77a-416c-8c95-0c97a07d2da6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:13.434928 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e49af690-a77a-416c-8c95-0c97a07d2da6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:13.492394 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6d6cea88-0f4c-4dda-afc7-25c84943aeb2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:13.506545 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6d6cea88-0f4c-4dda-afc7-25c84943aeb2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:13.508710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6d6cea88-0f4c-4dda-afc7-25c84943aeb2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:13.510270 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6d6cea88-0f4c-4dda-afc7-25c84943aeb2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1339 microversion: 2.20 time: 0.136575 Aug 24 08:56:13.511002 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 36/75] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:13 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1339 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:13.615263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e49af690-a77a-416c-8c95-0c97a07d2da6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:13.625676 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e49af690-a77a-416c-8c95-0c97a07d2da6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.207348 Aug 24 08:56:13.626425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 40/76] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:13 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:13.673441 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-662cc765-3d4b-4fa3-95de-719957c30c0d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:13.674034 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-662cc765-3d4b-4fa3-95de-719957c30c0d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:13.681112 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-662cc765-3d4b-4fa3-95de-719957c30c0d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:13.681593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-662cc765-3d4b-4fa3-95de-719957c30c0d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:13.682025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-662cc765-3d4b-4fa3-95de-719957c30c0d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:13.682739 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-662cc765-3d4b-4fa3-95de-719957c30c0d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:13.683189 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-662cc765-3d4b-4fa3-95de-719957c30c0d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:13.683610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-662cc765-3d4b-4fa3-95de-719957c30c0d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:13.753468 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-662cc765-3d4b-4fa3-95de-719957c30c0d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:13.762598 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-662cc765-3d4b-4fa3-95de-719957c30c0d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1300 microversion: 2.1 time: 0.092999 Aug 24 08:56:13.763198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 37/77] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:13 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:13.847793 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b3e19f9b-4197-47cf-a8f0-e053a1c6e602 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:13.848412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b3e19f9b-4197-47cf-a8f0-e053a1c6e602 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:13.855592 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b3e19f9b-4197-47cf-a8f0-e053a1c6e602 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:13.856201 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b3e19f9b-4197-47cf-a8f0-e053a1c6e602 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:13.856805 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b3e19f9b-4197-47cf-a8f0-e053a1c6e602 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:13.857632 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b3e19f9b-4197-47cf-a8f0-e053a1c6e602 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:13.858329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b3e19f9b-4197-47cf-a8f0-e053a1c6e602 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:13.858992 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b3e19f9b-4197-47cf-a8f0-e053a1c6e602 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:13.928976 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b3e19f9b-4197-47cf-a8f0-e053a1c6e602 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:13.937828 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b3e19f9b-4197-47cf-a8f0-e053a1c6e602 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1294 microversion: 2.1 time: 0.093971 Aug 24 08:56:13.938537 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 41/78] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:13 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:14.405788 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ccc93c9f-42f2-414e-856b-0d26d3fe345a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:14.406417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ccc93c9f-42f2-414e-856b-0d26d3fe345a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:14.413810 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ccc93c9f-42f2-414e-856b-0d26d3fe345a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.414437 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ccc93c9f-42f2-414e-856b-0d26d3fe345a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.414961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ccc93c9f-42f2-414e-856b-0d26d3fe345a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.415968 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ccc93c9f-42f2-414e-856b-0d26d3fe345a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.416567 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ccc93c9f-42f2-414e-856b-0d26d3fe345a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.417085 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ccc93c9f-42f2-414e-856b-0d26d3fe345a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.536906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5d1f0fd5-444e-47de-8652-89a9b5c18329 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:14.541846 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5d1f0fd5-444e-47de-8652-89a9b5c18329 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:14.541846 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=20 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:14.546741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5d1f0fd5-444e-47de-8652-89a9b5c18329 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.547329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5d1f0fd5-444e-47de-8652-89a9b5c18329 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.547846 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5d1f0fd5-444e-47de-8652-89a9b5c18329 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.548922 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5d1f0fd5-444e-47de-8652-89a9b5c18329 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.549687 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5d1f0fd5-444e-47de-8652-89a9b5c18329 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.550238 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5d1f0fd5-444e-47de-8652-89a9b5c18329 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.572440 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ccc93c9f-42f2-414e-856b-0d26d3fe345a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:14.586976 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ccc93c9f-42f2-414e-856b-0d26d3fe345a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.185166 Aug 24 08:56:14.588005 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 38/79] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:14 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:14.636809 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5d1f0fd5-444e-47de-8652-89a9b5c18329 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:14.646328 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5d1f0fd5-444e-47de-8652-89a9b5c18329 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:14.647910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5d1f0fd5-444e-47de-8652-89a9b5c18329 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:14.649241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5d1f0fd5-444e-47de-8652-89a9b5c18329 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1339 microversion: 2.20 time: 0.117284 Aug 24 08:56:14.649819 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 42/80] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:14 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1339 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:14.664406 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9429931c-1ddc-4bb7-9cd1-7ed5f44be0e4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:14.665544 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9429931c-1ddc-4bb7-9cd1-7ed5f44be0e4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:14.676607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9429931c-1ddc-4bb7-9cd1-7ed5f44be0e4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.678007 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9429931c-1ddc-4bb7-9cd1-7ed5f44be0e4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.678790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9429931c-1ddc-4bb7-9cd1-7ed5f44be0e4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.680122 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9429931c-1ddc-4bb7-9cd1-7ed5f44be0e4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.680995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9429931c-1ddc-4bb7-9cd1-7ed5f44be0e4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.681775 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9429931c-1ddc-4bb7-9cd1-7ed5f44be0e4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.788879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b0e51bca-8fb1-48e9-b86e-7a5819eca722 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:14.794376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b0e51bca-8fb1-48e9-b86e-7a5819eca722 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:14.798468 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0e51bca-8fb1-48e9-b86e-7a5819eca722 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.799339 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0e51bca-8fb1-48e9-b86e-7a5819eca722 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.799972 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0e51bca-8fb1-48e9-b86e-7a5819eca722 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.800948 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0e51bca-8fb1-48e9-b86e-7a5819eca722 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.801487 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0e51bca-8fb1-48e9-b86e-7a5819eca722 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.802609 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0e51bca-8fb1-48e9-b86e-7a5819eca722 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.856108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9429931c-1ddc-4bb7-9cd1-7ed5f44be0e4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:14.866829 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9429931c-1ddc-4bb7-9cd1-7ed5f44be0e4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.209871 Aug 24 08:56:14.867659 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 39/81] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:14 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:14.890828 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b0e51bca-8fb1-48e9-b86e-7a5819eca722 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:14.899712 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b0e51bca-8fb1-48e9-b86e-7a5819eca722 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1300 microversion: 2.1 time: 0.118057 Aug 24 08:56:14.900308 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 43/82] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:14 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:14.959968 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-716dc0a5-826e-4a36-91d1-49f1d89b771c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:14.960803 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-716dc0a5-826e-4a36-91d1-49f1d89b771c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:14.967344 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-716dc0a5-826e-4a36-91d1-49f1d89b771c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.967833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-716dc0a5-826e-4a36-91d1-49f1d89b771c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.968278 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-716dc0a5-826e-4a36-91d1-49f1d89b771c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.969075 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-716dc0a5-826e-4a36-91d1-49f1d89b771c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.969535 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-716dc0a5-826e-4a36-91d1-49f1d89b771c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.969960 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-716dc0a5-826e-4a36-91d1-49f1d89b771c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:15.039546 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-716dc0a5-826e-4a36-91d1-49f1d89b771c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:15.047979 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-716dc0a5-826e-4a36-91d1-49f1d89b771c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1294 microversion: 2.1 time: 0.092064 Aug 24 08:56:15.048604 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 40/83] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:14 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:15.620455 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f47865ee-3d46-4e97-ba35-d4373c034e81 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:15.621351 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f47865ee-3d46-4e97-ba35-d4373c034e81 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:15.628050 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f47865ee-3d46-4e97-ba35-d4373c034e81 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:15.628654 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f47865ee-3d46-4e97-ba35-d4373c034e81 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:15.629143 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f47865ee-3d46-4e97-ba35-d4373c034e81 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:15.630429 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f47865ee-3d46-4e97-ba35-d4373c034e81 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:15.630911 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f47865ee-3d46-4e97-ba35-d4373c034e81 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:15.631749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f47865ee-3d46-4e97-ba35-d4373c034e81 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:15.674157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-10b2305e-a06b-43b3-b00d-d33837e75162 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:15.674796 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-10b2305e-a06b-43b3-b00d-d33837e75162 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:15.688414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-10b2305e-a06b-43b3-b00d-d33837e75162 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:15.689470 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-10b2305e-a06b-43b3-b00d-d33837e75162 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:15.689919 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-10b2305e-a06b-43b3-b00d-d33837e75162 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:15.690649 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-10b2305e-a06b-43b3-b00d-d33837e75162 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:15.691104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-10b2305e-a06b-43b3-b00d-d33837e75162 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:15.691772 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-10b2305e-a06b-43b3-b00d-d33837e75162 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:15.810074 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-10b2305e-a06b-43b3-b00d-d33837e75162 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:15.881366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-10b2305e-a06b-43b3-b00d-d33837e75162 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:15.884251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-10b2305e-a06b-43b3-b00d-d33837e75162 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:15.886162 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-10b2305e-a06b-43b3-b00d-d33837e75162 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1339 microversion: 2.20 time: 0.215883 Aug 24 08:56:15.887063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 41/84] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:15 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1339 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:15.920069 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-62e06136-8d47-4f56-a321-298d77766dea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:15.921835 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-62e06136-8d47-4f56-a321-298d77766dea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:15.922520 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f47865ee-3d46-4e97-ba35-d4373c034e81 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:15.934495 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62e06136-8d47-4f56-a321-298d77766dea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:15.935674 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62e06136-8d47-4f56-a321-298d77766dea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:15.936671 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62e06136-8d47-4f56-a321-298d77766dea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:15.938330 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62e06136-8d47-4f56-a321-298d77766dea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:15.939232 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62e06136-8d47-4f56-a321-298d77766dea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:15.940117 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62e06136-8d47-4f56-a321-298d77766dea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:15.942935 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f47865ee-3d46-4e97-ba35-d4373c034e81 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.325989 Aug 24 08:56:15.945017 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 44/85] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:15 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:15.954267 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cd034d93-8acd-49c0-bafb-c6d0485a9fff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:15.955859 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-cd034d93-8acd-49c0-bafb-c6d0485a9fff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:15.968597 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cd034d93-8acd-49c0-bafb-c6d0485a9fff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:15.970037 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cd034d93-8acd-49c0-bafb-c6d0485a9fff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:15.971068 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cd034d93-8acd-49c0-bafb-c6d0485a9fff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:15.972683 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cd034d93-8acd-49c0-bafb-c6d0485a9fff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:15.974027 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cd034d93-8acd-49c0-bafb-c6d0485a9fff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:15.975017 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cd034d93-8acd-49c0-bafb-c6d0485a9fff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:16.077600 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-cd034d93-8acd-49c0-bafb-c6d0485a9fff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:16.086361 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-cd034d93-8acd-49c0-bafb-c6d0485a9fff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1300 microversion: 2.1 time: 0.139420 Aug 24 08:56:16.087064 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 45/86] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:15 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:16.092578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c65cb99c-80ff-46b5-9d28-96a598408ec1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:16.093210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c65cb99c-80ff-46b5-9d28-96a598408ec1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:16.100819 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c65cb99c-80ff-46b5-9d28-96a598408ec1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:16.101617 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c65cb99c-80ff-46b5-9d28-96a598408ec1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:16.102220 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c65cb99c-80ff-46b5-9d28-96a598408ec1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:16.102948 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c65cb99c-80ff-46b5-9d28-96a598408ec1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:16.103645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c65cb99c-80ff-46b5-9d28-96a598408ec1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:16.104072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c65cb99c-80ff-46b5-9d28-96a598408ec1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:16.162136 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-62e06136-8d47-4f56-a321-298d77766dea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:16.171991 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-62e06136-8d47-4f56-a321-298d77766dea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.258916 Aug 24 08:56:16.172836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 42/87] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:15 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:16.197581 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c65cb99c-80ff-46b5-9d28-96a598408ec1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:16.212478 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c65cb99c-80ff-46b5-9d28-96a598408ec1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1294 microversion: 2.1 time: 0.123837 Aug 24 08:56:16.213642 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 46/88] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:16 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1294 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:16.922589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-94923084-96d8-416d-a9d2-5a17de0e5d94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:16.928900 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-94923084-96d8-416d-a9d2-5a17de0e5d94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:16.936097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-94923084-96d8-416d-a9d2-5a17de0e5d94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:16.936714 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-94923084-96d8-416d-a9d2-5a17de0e5d94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:16.937242 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-94923084-96d8-416d-a9d2-5a17de0e5d94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:16.938236 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-94923084-96d8-416d-a9d2-5a17de0e5d94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:16.938807 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-94923084-96d8-416d-a9d2-5a17de0e5d94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:16.939338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-94923084-96d8-416d-a9d2-5a17de0e5d94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:16.984232 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4fe16243-2f0c-4325-9554-4b99fa757c5c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:16.985204 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4fe16243-2f0c-4325-9554-4b99fa757c5c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:16.992605 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4fe16243-2f0c-4325-9554-4b99fa757c5c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:16.992605 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4fe16243-2f0c-4325-9554-4b99fa757c5c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:16.996701 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4fe16243-2f0c-4325-9554-4b99fa757c5c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:16.996701 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4fe16243-2f0c-4325-9554-4b99fa757c5c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:16.996701 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4fe16243-2f0c-4325-9554-4b99fa757c5c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:16.996701 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4fe16243-2f0c-4325-9554-4b99fa757c5c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:17.000990 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:17.059682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-94923084-96d8-416d-a9d2-5a17de0e5d94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:17.080699 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-94923084-96d8-416d-a9d2-5a17de0e5d94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:17.084018 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-94923084-96d8-416d-a9d2-5a17de0e5d94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:17.086160 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-94923084-96d8-416d-a9d2-5a17de0e5d94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1339 microversion: 2.20 time: 0.168522 Aug 24 08:56:17.087683 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 43/89] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:16 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1339 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:17.123701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fa3d0996-0048-4a9f-901a-8fe0bf43c6e1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:17.125606 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fa3d0996-0048-4a9f-901a-8fe0bf43c6e1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:17.137352 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fa3d0996-0048-4a9f-901a-8fe0bf43c6e1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:17.138185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fa3d0996-0048-4a9f-901a-8fe0bf43c6e1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:17.138878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fa3d0996-0048-4a9f-901a-8fe0bf43c6e1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:17.140094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fa3d0996-0048-4a9f-901a-8fe0bf43c6e1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:17.140966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fa3d0996-0048-4a9f-901a-8fe0bf43c6e1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:17.141707 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fa3d0996-0048-4a9f-901a-8fe0bf43c6e1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:17.179053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4fe16243-2f0c-4325-9554-4b99fa757c5c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:17.193395 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4fe16243-2f0c-4325-9554-4b99fa757c5c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.211986 Aug 24 08:56:17.199345 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 47/90] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:16 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:17.207193 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4f3e5cb6-4e1c-46c7-b3fa-8d76cf247be9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:17.208261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4f3e5cb6-4e1c-46c7-b3fa-8d76cf247be9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:17.219360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f3e5cb6-4e1c-46c7-b3fa-8d76cf247be9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:17.219855 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f3e5cb6-4e1c-46c7-b3fa-8d76cf247be9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:17.220467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f3e5cb6-4e1c-46c7-b3fa-8d76cf247be9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:17.221341 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f3e5cb6-4e1c-46c7-b3fa-8d76cf247be9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:17.221912 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f3e5cb6-4e1c-46c7-b3fa-8d76cf247be9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:17.222395 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f3e5cb6-4e1c-46c7-b3fa-8d76cf247be9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:17.260685 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fa3d0996-0048-4a9f-901a-8fe0bf43c6e1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:17.274133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fa3d0996-0048-4a9f-901a-8fe0bf43c6e1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1300 microversion: 2.1 time: 0.157968 Aug 24 08:56:17.274804 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 44/91] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:17 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:17.281699 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-22663e21-927e-482b-a5f4-b36ac37568dc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:17.282612 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-22663e21-927e-482b-a5f4-b36ac37568dc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:17.306499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22663e21-927e-482b-a5f4-b36ac37568dc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:17.307423 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22663e21-927e-482b-a5f4-b36ac37568dc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:17.308241 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22663e21-927e-482b-a5f4-b36ac37568dc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:17.309428 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22663e21-927e-482b-a5f4-b36ac37568dc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:17.309902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22663e21-927e-482b-a5f4-b36ac37568dc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:17.310340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22663e21-927e-482b-a5f4-b36ac37568dc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:17.413852 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-22663e21-927e-482b-a5f4-b36ac37568dc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:17.428517 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-22663e21-927e-482b-a5f4-b36ac37568dc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1294 microversion: 2.1 time: 0.151913 Aug 24 08:56:17.429825 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 45/92] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:17 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1294 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:17.650958 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4f3e5cb6-4e1c-46c7-b3fa-8d76cf247be9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:17.664689 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4f3e5cb6-4e1c-46c7-b3fa-8d76cf247be9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.468611 Aug 24 08:56:17.665620 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 48/93] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:17 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:18.125781 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4b1d1210-efdf-40d4-9458-e92b3b18a343 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:18.126639 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4b1d1210-efdf-40d4-9458-e92b3b18a343 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:18.133565 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4b1d1210-efdf-40d4-9458-e92b3b18a343 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:18.134063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4b1d1210-efdf-40d4-9458-e92b3b18a343 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:18.134492 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4b1d1210-efdf-40d4-9458-e92b3b18a343 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:18.135429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4b1d1210-efdf-40d4-9458-e92b3b18a343 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:18.135896 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4b1d1210-efdf-40d4-9458-e92b3b18a343 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:18.136326 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4b1d1210-efdf-40d4-9458-e92b3b18a343 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:18.218361 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8cdcddb8-bbf4-4274-ad16-aafe84fdf98c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:18.222353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8cdcddb8-bbf4-4274-ad16-aafe84fdf98c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:18.231881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8cdcddb8-bbf4-4274-ad16-aafe84fdf98c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:18.232578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8cdcddb8-bbf4-4274-ad16-aafe84fdf98c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:18.233390 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8cdcddb8-bbf4-4274-ad16-aafe84fdf98c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:18.234275 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8cdcddb8-bbf4-4274-ad16-aafe84fdf98c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:18.234870 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8cdcddb8-bbf4-4274-ad16-aafe84fdf98c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:18.235452 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8cdcddb8-bbf4-4274-ad16-aafe84fdf98c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:18.296220 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4b1d1210-efdf-40d4-9458-e92b3b18a343 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:18.318303 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4b1d1210-efdf-40d4-9458-e92b3b18a343 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:18.328675 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4b1d1210-efdf-40d4-9458-e92b3b18a343 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:18.331167 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4b1d1210-efdf-40d4-9458-e92b3b18a343 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1339 microversion: 2.20 time: 0.209378 Aug 24 08:56:18.332646 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 46/94] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:18 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1339 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:18.345539 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a9eb3595-49c3-469b-94ea-1ccb9d425ea0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:18.354280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a9eb3595-49c3-469b-94ea-1ccb9d425ea0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:18.369862 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9eb3595-49c3-469b-94ea-1ccb9d425ea0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:18.371096 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9eb3595-49c3-469b-94ea-1ccb9d425ea0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:18.372177 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9eb3595-49c3-469b-94ea-1ccb9d425ea0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:18.373906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9eb3595-49c3-469b-94ea-1ccb9d425ea0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:18.375431 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9eb3595-49c3-469b-94ea-1ccb9d425ea0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:18.376057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9eb3595-49c3-469b-94ea-1ccb9d425ea0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:18.382856 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:18.539504 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a9eb3595-49c3-469b-94ea-1ccb9d425ea0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:18.548687 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a9eb3595-49c3-469b-94ea-1ccb9d425ea0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1300 microversion: 2.1 time: 0.214139 Aug 24 08:56:18.549961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 47/95] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:18 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1300 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:18.555319 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7b507ae1-960d-4efd-9950-675f899646a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:18.556285 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7b507ae1-960d-4efd-9950-675f899646a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:18.563603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7b507ae1-960d-4efd-9950-675f899646a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:18.564482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7b507ae1-960d-4efd-9950-675f899646a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:18.565173 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7b507ae1-960d-4efd-9950-675f899646a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:18.566221 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7b507ae1-960d-4efd-9950-675f899646a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:18.566979 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7b507ae1-960d-4efd-9950-675f899646a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:18.568160 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7b507ae1-960d-4efd-9950-675f899646a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:18.716187 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7b507ae1-960d-4efd-9950-675f899646a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:18.738410 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7b507ae1-960d-4efd-9950-675f899646a9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1294 microversion: 2.1 time: 0.186584 Aug 24 08:56:18.740861 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 48/96] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:18 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1294 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:18.747974 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-cd875d08-ee3e-405c-b233-c274b0fddf7e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:18.749219 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-cd875d08-ee3e-405c-b233-c274b0fddf7e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:18.760166 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd875d08-ee3e-405c-b233-c274b0fddf7e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:18.761205 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd875d08-ee3e-405c-b233-c274b0fddf7e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:18.762209 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd875d08-ee3e-405c-b233-c274b0fddf7e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:18.764570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd875d08-ee3e-405c-b233-c274b0fddf7e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:18.766282 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd875d08-ee3e-405c-b233-c274b0fddf7e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:18.766967 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd875d08-ee3e-405c-b233-c274b0fddf7e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:19.044102 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-cd875d08-ee3e-405c-b233-c274b0fddf7e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:19.052040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-cd875d08-ee3e-405c-b233-c274b0fddf7e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.309705 Aug 24 08:56:19.052673 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 49/97] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:18 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:19.244196 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8cdcddb8-bbf4-4274-ad16-aafe84fdf98c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:19.256963 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8cdcddb8-bbf4-4274-ad16-aafe84fdf98c tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 1.043934 Aug 24 08:56:19.263180 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 49/98] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:18 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:19.368856 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-efe3b711-6329-4a9f-8d7e-470116efb0eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:19.370145 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-efe3b711-6329-4a9f-8d7e-470116efb0eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:19.381190 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-efe3b711-6329-4a9f-8d7e-470116efb0eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:19.382044 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-efe3b711-6329-4a9f-8d7e-470116efb0eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:19.382700 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-efe3b711-6329-4a9f-8d7e-470116efb0eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:19.383658 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-efe3b711-6329-4a9f-8d7e-470116efb0eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:19.384468 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-efe3b711-6329-4a9f-8d7e-470116efb0eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:19.385101 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-efe3b711-6329-4a9f-8d7e-470116efb0eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:19.500348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-efe3b711-6329-4a9f-8d7e-470116efb0eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:19.537176 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-efe3b711-6329-4a9f-8d7e-470116efb0eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:19.537176 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-efe3b711-6329-4a9f-8d7e-470116efb0eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:19.537176 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-efe3b711-6329-4a9f-8d7e-470116efb0eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1339 microversion: 2.20 time: 0.164101 Aug 24 08:56:19.537466 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 50/99] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:19 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1339 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:19.579587 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0d48db79-b22c-4f86-a409-21a7acf353fe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:19.580509 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0d48db79-b22c-4f86-a409-21a7acf353fe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:19.597544 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0d48db79-b22c-4f86-a409-21a7acf353fe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:19.598442 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0d48db79-b22c-4f86-a409-21a7acf353fe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:19.599661 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0d48db79-b22c-4f86-a409-21a7acf353fe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:19.600792 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0d48db79-b22c-4f86-a409-21a7acf353fe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:19.601542 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0d48db79-b22c-4f86-a409-21a7acf353fe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:19.602179 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0d48db79-b22c-4f86-a409-21a7acf353fe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:19.761618 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-cda1d163-1e65-462b-b8bb-eb4b3da21f82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:19.762495 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-cda1d163-1e65-462b-b8bb-eb4b3da21f82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:19.771314 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cda1d163-1e65-462b-b8bb-eb4b3da21f82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:19.771994 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cda1d163-1e65-462b-b8bb-eb4b3da21f82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:19.772726 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cda1d163-1e65-462b-b8bb-eb4b3da21f82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:19.773753 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cda1d163-1e65-462b-b8bb-eb4b3da21f82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:19.774584 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cda1d163-1e65-462b-b8bb-eb4b3da21f82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:19.775170 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cda1d163-1e65-462b-b8bb-eb4b3da21f82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:19.998249 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-cda1d163-1e65-462b-b8bb-eb4b3da21f82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.018334 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-cda1d163-1e65-462b-b8bb-eb4b3da21f82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.260784 Aug 24 08:56:20.018948 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 51/100] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:19 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:20.021989 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0d48db79-b22c-4f86-a409-21a7acf353fe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.035260 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0d48db79-b22c-4f86-a409-21a7acf353fe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.468673 Aug 24 08:56:20.048791 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 50/101] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:19 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:20.073958 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-697d1d93-535f-4ba1-872d-51e4b264bfd2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:20.074526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-697d1d93-535f-4ba1-872d-51e4b264bfd2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:20.083892 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-697d1d93-535f-4ba1-872d-51e4b264bfd2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.084397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-697d1d93-535f-4ba1-872d-51e4b264bfd2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.084871 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-697d1d93-535f-4ba1-872d-51e4b264bfd2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.085609 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-697d1d93-535f-4ba1-872d-51e4b264bfd2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.086068 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-697d1d93-535f-4ba1-872d-51e4b264bfd2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.086489 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-697d1d93-535f-4ba1-872d-51e4b264bfd2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.113226 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-e49ad548-9213-42d8-8699-eb21e0a0da7c req-58114ef5-2b87-43e8-9f60-5607f36c8983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91522d87-2654-4cee-9b8c-b7431ed55dd3", "tag": "4a80d617-a0d7-4cc6-b5b2-6590c4bdea44"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:20.142140 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e49ad548-9213-42d8-8699-eb21e0a0da7c req-58114ef5-2b87-43e8-9f60-5607f36c8983 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.142809 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e49ad548-9213-42d8-8699-eb21e0a0da7c req-58114ef5-2b87-43e8-9f60-5607f36c8983 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.143554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e49ad548-9213-42d8-8699-eb21e0a0da7c req-58114ef5-2b87-43e8-9f60-5607f36c8983 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.186766 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-e49ad548-9213-42d8-8699-eb21e0a0da7c req-58114ef5-2b87-43e8-9f60-5607f36c8983 service nova] Creating event network-changed:4a80d617-a0d7-4cc6-b5b2-6590c4bdea44 for instance 91522d87-2654-4cee-9b8c-b7431ed55dd3 on hv-cinder-85221 Aug 24 08:56:20.191649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e49ad548-9213-42d8-8699-eb21e0a0da7c req-58114ef5-2b87-43e8-9f60-5607f36c8983 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132985) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 08:56:20.191649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e49ad548-9213-42d8-8699-eb21e0a0da7c req-58114ef5-2b87-43e8-9f60-5607f36c8983 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132985) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 08:56:20.191649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f838bbe3-d8d5-4b4e-9169-ccc8c35b44fe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.191649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f838bbe3-d8d5-4b4e-9169-ccc8c35b44fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.191649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f838bbe3-d8d5-4b4e-9169-ccc8c35b44fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.193284 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f838bbe3-d8d5-4b4e-9169-ccc8c35b44fe None None] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.193284 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f838bbe3-d8d5-4b4e-9169-ccc8c35b44fe None None] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.194213 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f838bbe3-d8d5-4b4e-9169-ccc8c35b44fe None None] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.208668 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.compute.rpcapi [None req-f838bbe3-d8d5-4b4e-9169-ccc8c35b44fe None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 08:56:20.210040 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f838bbe3-d8d5-4b4e-9169-ccc8c35b44fe None None] Releasing lock "compute-rpcapi-router" {{(pid=132985) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 08:56:20.238979 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f838bbe3-d8d5-4b4e-9169-ccc8c35b44fe None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135799 Aug 24 08:56:20.240697 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 51/102] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:20.267129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-697d1d93-535f-4ba1-872d-51e4b264bfd2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.277283 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-697d1d93-535f-4ba1-872d-51e4b264bfd2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.208105 Aug 24 08:56:20.278393 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 52/103] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:20 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:20.290702 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-11c1af4e-59ea-40a2-8f41-78aeb13728ac tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:20.291525 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-11c1af4e-59ea-40a2-8f41-78aeb13728ac tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:20.298573 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11c1af4e-59ea-40a2-8f41-78aeb13728ac tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.299063 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11c1af4e-59ea-40a2-8f41-78aeb13728ac tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.299501 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11c1af4e-59ea-40a2-8f41-78aeb13728ac tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.300219 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11c1af4e-59ea-40a2-8f41-78aeb13728ac tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.300707 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11c1af4e-59ea-40a2-8f41-78aeb13728ac tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.301132 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11c1af4e-59ea-40a2-8f41-78aeb13728ac tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.480693 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-11c1af4e-59ea-40a2-8f41-78aeb13728ac tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.489344 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-11c1af4e-59ea-40a2-8f41-78aeb13728ac tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.202954 Aug 24 08:56:20.492749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 52/104] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:20 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:20.551199 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-af9ea890-ffee-448f-bc46-b6842b5f4443 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:20.552029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-af9ea890-ffee-448f-bc46-b6842b5f4443 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:20.558702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af9ea890-ffee-448f-bc46-b6842b5f4443 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.559188 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af9ea890-ffee-448f-bc46-b6842b5f4443 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.559620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af9ea890-ffee-448f-bc46-b6842b5f4443 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.560584 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af9ea890-ffee-448f-bc46-b6842b5f4443 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.561114 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af9ea890-ffee-448f-bc46-b6842b5f4443 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.561539 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af9ea890-ffee-448f-bc46-b6842b5f4443 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.713429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-af9ea890-ffee-448f-bc46-b6842b5f4443 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.722711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-af9ea890-ffee-448f-bc46-b6842b5f4443 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.724382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-af9ea890-ffee-448f-bc46-b6842b5f4443 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.725571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-af9ea890-ffee-448f-bc46-b6842b5f4443 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.179267 Aug 24 08:56:20.726152 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 53/105] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:20 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:21.039925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-424a6828-23fc-4891-8ef3-27ea817c62db tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:21.040639 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-424a6828-23fc-4891-8ef3-27ea817c62db tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:21.047218 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-424a6828-23fc-4891-8ef3-27ea817c62db tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.047706 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-424a6828-23fc-4891-8ef3-27ea817c62db tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.048139 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-424a6828-23fc-4891-8ef3-27ea817c62db tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.048913 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-424a6828-23fc-4891-8ef3-27ea817c62db tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.049363 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-424a6828-23fc-4891-8ef3-27ea817c62db tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.049786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-424a6828-23fc-4891-8ef3-27ea817c62db tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.056915 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d4a4194d-65b2-4940-8824-a14b3bfaecc2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:21.057652 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d4a4194d-65b2-4940-8824-a14b3bfaecc2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:21.066157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4a4194d-65b2-4940-8824-a14b3bfaecc2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.066890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4a4194d-65b2-4940-8824-a14b3bfaecc2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.068156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4a4194d-65b2-4940-8824-a14b3bfaecc2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.069380 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4a4194d-65b2-4940-8824-a14b3bfaecc2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.070134 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4a4194d-65b2-4940-8824-a14b3bfaecc2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.070666 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4a4194d-65b2-4940-8824-a14b3bfaecc2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.237923 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d4a4194d-65b2-4940-8824-a14b3bfaecc2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:21.244219 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-424a6828-23fc-4891-8ef3-27ea817c62db tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:21.249067 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d4a4194d-65b2-4940-8824-a14b3bfaecc2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.197073 Aug 24 08:56:21.249673 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 54/106] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:21 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:21.259982 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-424a6828-23fc-4891-8ef3-27ea817c62db tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.223632 Aug 24 08:56:21.261078 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 53/107] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:21 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:21.301318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-83d9fdba-9f46-4625-a48f-d1ba821a024d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:21.302428 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-83d9fdba-9f46-4625-a48f-d1ba821a024d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:21.309047 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-83d9fdba-9f46-4625-a48f-d1ba821a024d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.309535 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-83d9fdba-9f46-4625-a48f-d1ba821a024d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.309967 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-83d9fdba-9f46-4625-a48f-d1ba821a024d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.310667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-83d9fdba-9f46-4625-a48f-d1ba821a024d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.311119 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-83d9fdba-9f46-4625-a48f-d1ba821a024d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.311541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-83d9fdba-9f46-4625-a48f-d1ba821a024d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.475919 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-83d9fdba-9f46-4625-a48f-d1ba821a024d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:21.484158 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-83d9fdba-9f46-4625-a48f-d1ba821a024d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.187408 Aug 24 08:56:21.484779 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 55/108] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:21 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:21.511549 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-bf714296-6183-43d9-8abb-f8c4b581b119 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:21.512200 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-bf714296-6183-43d9-8abb-f8c4b581b119 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:21.519039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bf714296-6183-43d9-8abb-f8c4b581b119 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.519574 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bf714296-6183-43d9-8abb-f8c4b581b119 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.520062 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bf714296-6183-43d9-8abb-f8c4b581b119 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.520888 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bf714296-6183-43d9-8abb-f8c4b581b119 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.521384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bf714296-6183-43d9-8abb-f8c4b581b119 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.521895 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bf714296-6183-43d9-8abb-f8c4b581b119 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.724799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-bf714296-6183-43d9-8abb-f8c4b581b119 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:21.733370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-bf714296-6183-43d9-8abb-f8c4b581b119 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.225671 Aug 24 08:56:21.734033 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 54/109] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:21 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:21.751481 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-97da7f49-7bf6-4970-afb5-4b1317d87145 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:21.752632 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-97da7f49-7bf6-4970-afb5-4b1317d87145 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:21.763496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da7f49-7bf6-4970-afb5-4b1317d87145 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.764340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da7f49-7bf6-4970-afb5-4b1317d87145 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.765150 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da7f49-7bf6-4970-afb5-4b1317d87145 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.766393 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da7f49-7bf6-4970-afb5-4b1317d87145 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.767191 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da7f49-7bf6-4970-afb5-4b1317d87145 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.767973 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da7f49-7bf6-4970-afb5-4b1317d87145 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.918508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-97da7f49-7bf6-4970-afb5-4b1317d87145 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:21.928203 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-97da7f49-7bf6-4970-afb5-4b1317d87145 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:21.930227 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-97da7f49-7bf6-4970-afb5-4b1317d87145 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:21.931507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-97da7f49-7bf6-4970-afb5-4b1317d87145 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.187440 Aug 24 08:56:21.932273 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 56/110] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:21 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:22.272414 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2828b237-3efb-4fa4-bb9e-bbad4d7c5ea7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:22.272949 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2828b237-3efb-4fa4-bb9e-bbad4d7c5ea7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:22.279858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2828b237-3efb-4fa4-bb9e-bbad4d7c5ea7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.280363 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2828b237-3efb-4fa4-bb9e-bbad4d7c5ea7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.280828 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2828b237-3efb-4fa4-bb9e-bbad4d7c5ea7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.281544 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2828b237-3efb-4fa4-bb9e-bbad4d7c5ea7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.281998 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2828b237-3efb-4fa4-bb9e-bbad4d7c5ea7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.282419 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2828b237-3efb-4fa4-bb9e-bbad4d7c5ea7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.283310 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-db377a03-eb4a-476d-885f-36bd59ca6d39 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:22.284145 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-db377a03-eb4a-476d-885f-36bd59ca6d39 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:22.294818 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db377a03-eb4a-476d-885f-36bd59ca6d39 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.295652 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db377a03-eb4a-476d-885f-36bd59ca6d39 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.296433 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db377a03-eb4a-476d-885f-36bd59ca6d39 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.297712 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db377a03-eb4a-476d-885f-36bd59ca6d39 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.298566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db377a03-eb4a-476d-885f-36bd59ca6d39 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.300048 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db377a03-eb4a-476d-885f-36bd59ca6d39 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.498011 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2828b237-3efb-4fa4-bb9e-bbad4d7c5ea7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:22.498289 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-db377a03-eb4a-476d-885f-36bd59ca6d39 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:22.498614 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2828b237-3efb-4fa4-bb9e-bbad4d7c5ea7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.221646 Aug 24 08:56:22.498614 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 55/111] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:22 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:22.502861 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-db377a03-eb4a-476d-885f-36bd59ca6d39 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.223548 Aug 24 08:56:22.503929 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 57/112] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:22 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:22.508676 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-67423ed1-a671-460a-812a-c0038690b342 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:22.509444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-67423ed1-a671-460a-812a-c0038690b342 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:22.518418 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67423ed1-a671-460a-812a-c0038690b342 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.519136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67423ed1-a671-460a-812a-c0038690b342 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.519604 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67423ed1-a671-460a-812a-c0038690b342 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.521040 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67423ed1-a671-460a-812a-c0038690b342 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.521626 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67423ed1-a671-460a-812a-c0038690b342 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.522234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67423ed1-a671-460a-812a-c0038690b342 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.692520 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-67423ed1-a671-460a-812a-c0038690b342 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:22.701568 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-67423ed1-a671-460a-812a-c0038690b342 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.196785 Aug 24 08:56:22.702159 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 56/113] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:22 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:22.755881 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-78983df3-dd07-4fb0-82d6-cc65d72d917f tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:22.756665 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-78983df3-dd07-4fb0-82d6-cc65d72d917f tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:22.764800 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-78983df3-dd07-4fb0-82d6-cc65d72d917f tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.765431 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-78983df3-dd07-4fb0-82d6-cc65d72d917f tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.766061 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-78983df3-dd07-4fb0-82d6-cc65d72d917f tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.767008 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-78983df3-dd07-4fb0-82d6-cc65d72d917f tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.767596 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-78983df3-dd07-4fb0-82d6-cc65d72d917f tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.768129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-78983df3-dd07-4fb0-82d6-cc65d72d917f tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.941950 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-78983df3-dd07-4fb0-82d6-cc65d72d917f tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:22.955618 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1531da26-c31d-4801-a4d5-80ae8ec2e2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:22.956267 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1531da26-c31d-4801-a4d5-80ae8ec2e2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:22.956996 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-78983df3-dd07-4fb0-82d6-cc65d72d917f tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.203992 Aug 24 08:56:22.958899 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 58/114] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:22 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:22.964495 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1531da26-c31d-4801-a4d5-80ae8ec2e2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.965104 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1531da26-c31d-4801-a4d5-80ae8ec2e2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.965546 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1531da26-c31d-4801-a4d5-80ae8ec2e2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.966338 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1531da26-c31d-4801-a4d5-80ae8ec2e2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.967286 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1531da26-c31d-4801-a4d5-80ae8ec2e2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.967803 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1531da26-c31d-4801-a4d5-80ae8ec2e2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:23.175355 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1531da26-c31d-4801-a4d5-80ae8ec2e2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:23.185093 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1531da26-c31d-4801-a4d5-80ae8ec2e2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:23.186632 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1531da26-c31d-4801-a4d5-80ae8ec2e2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:23.187879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1531da26-c31d-4801-a4d5-80ae8ec2e2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.236256 Aug 24 08:56:23.188566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 57/115] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:22 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:23.527924 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-02cce70b-61a9-4d71-a356-265c88cd1575 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:23.528612 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-02cce70b-61a9-4d71-a356-265c88cd1575 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:23.536006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-02cce70b-61a9-4d71-a356-265c88cd1575 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:23.536503 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-02cce70b-61a9-4d71-a356-265c88cd1575 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:23.536991 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-02cce70b-61a9-4d71-a356-265c88cd1575 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:23.537716 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-02cce70b-61a9-4d71-a356-265c88cd1575 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:23.538172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-02cce70b-61a9-4d71-a356-265c88cd1575 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:23.538380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c41ce785-605c-4072-9c9b-324235376293 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:23.539004 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-02cce70b-61a9-4d71-a356-265c88cd1575 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:23.539150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c41ce785-605c-4072-9c9b-324235376293 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:23.547356 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c41ce785-605c-4072-9c9b-324235376293 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:23.548148 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c41ce785-605c-4072-9c9b-324235376293 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:23.548884 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c41ce785-605c-4072-9c9b-324235376293 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:23.550056 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c41ce785-605c-4072-9c9b-324235376293 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:23.550806 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c41ce785-605c-4072-9c9b-324235376293 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:23.552021 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c41ce785-605c-4072-9c9b-324235376293 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:23.747493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-02cce70b-61a9-4d71-a356-265c88cd1575 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:23.757823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-02cce70b-61a9-4d71-a356-265c88cd1575 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.234582 Aug 24 08:56:23.758894 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 59/116] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:23 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:23.768597 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-73224eeb-5d15-4c76-b2b4-40cd53a42ee7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:23.769710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-73224eeb-5d15-4c76-b2b4-40cd53a42ee7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:23.782559 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-73224eeb-5d15-4c76-b2b4-40cd53a42ee7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:23.783203 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-73224eeb-5d15-4c76-b2b4-40cd53a42ee7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:23.783721 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-73224eeb-5d15-4c76-b2b4-40cd53a42ee7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:23.784928 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-73224eeb-5d15-4c76-b2b4-40cd53a42ee7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:23.785426 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c41ce785-605c-4072-9c9b-324235376293 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:23.785823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-73224eeb-5d15-4c76-b2b4-40cd53a42ee7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:23.786349 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-73224eeb-5d15-4c76-b2b4-40cd53a42ee7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:23.795554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c41ce785-605c-4072-9c9b-324235376293 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.261555 Aug 24 08:56:23.796167 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 58/117] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:23 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:23.956287 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-73224eeb-5d15-4c76-b2b4-40cd53a42ee7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:23.965480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-73224eeb-5d15-4c76-b2b4-40cd53a42ee7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.204902 Aug 24 08:56:23.966071 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 60/118] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:23 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:23.984651 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6296672b-df7e-449f-b22c-1faf1468b7ee tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:23.985280 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6296672b-df7e-449f-b22c-1faf1468b7ee tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:23.991954 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6296672b-df7e-449f-b22c-1faf1468b7ee tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:23.992446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6296672b-df7e-449f-b22c-1faf1468b7ee tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:23.998791 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6296672b-df7e-449f-b22c-1faf1468b7ee tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:23.998791 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6296672b-df7e-449f-b22c-1faf1468b7ee tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:23.998791 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6296672b-df7e-449f-b22c-1faf1468b7ee tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:23.998791 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6296672b-df7e-449f-b22c-1faf1468b7ee tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.151282 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6296672b-df7e-449f-b22c-1faf1468b7ee tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:24.160860 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6296672b-df7e-449f-b22c-1faf1468b7ee tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.180322 Aug 24 08:56:24.161742 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 59/119] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:23 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:24.214987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-db479ed9-cbc0-44de-bd0f-f779bb7b5b09 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:24.215646 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-db479ed9-cbc0-44de-bd0f-f779bb7b5b09 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:24.222500 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db479ed9-cbc0-44de-bd0f-f779bb7b5b09 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.223068 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db479ed9-cbc0-44de-bd0f-f779bb7b5b09 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.223852 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db479ed9-cbc0-44de-bd0f-f779bb7b5b09 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.224756 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db479ed9-cbc0-44de-bd0f-f779bb7b5b09 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.225263 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db479ed9-cbc0-44de-bd0f-f779bb7b5b09 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.225738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db479ed9-cbc0-44de-bd0f-f779bb7b5b09 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.387276 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-db479ed9-cbc0-44de-bd0f-f779bb7b5b09 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:24.396373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-db479ed9-cbc0-44de-bd0f-f779bb7b5b09 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:24.397959 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-db479ed9-cbc0-44de-bd0f-f779bb7b5b09 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:24.399100 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-db479ed9-cbc0-44de-bd0f-f779bb7b5b09 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.190447 Aug 24 08:56:24.399673 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 61/120] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:24 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:24.796828 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-be16c054-ee75-4b43-b250-f4edfefe817f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:24.797461 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-be16c054-ee75-4b43-b250-f4edfefe817f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:24.804904 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be16c054-ee75-4b43-b250-f4edfefe817f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.805396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be16c054-ee75-4b43-b250-f4edfefe817f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.805872 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be16c054-ee75-4b43-b250-f4edfefe817f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.806588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be16c054-ee75-4b43-b250-f4edfefe817f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.807042 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be16c054-ee75-4b43-b250-f4edfefe817f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.807478 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be16c054-ee75-4b43-b250-f4edfefe817f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.830590 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2f067309-fd20-4c5d-87ac-69bc249f612b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:24.831269 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2f067309-fd20-4c5d-87ac-69bc249f612b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:24.838100 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2f067309-fd20-4c5d-87ac-69bc249f612b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.838589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2f067309-fd20-4c5d-87ac-69bc249f612b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.839029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2f067309-fd20-4c5d-87ac-69bc249f612b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.839742 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2f067309-fd20-4c5d-87ac-69bc249f612b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.840210 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2f067309-fd20-4c5d-87ac-69bc249f612b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.840655 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2f067309-fd20-4c5d-87ac-69bc249f612b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.013515 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-be16c054-ee75-4b43-b250-f4edfefe817f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.014733 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2f067309-fd20-4c5d-87ac-69bc249f612b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.024011 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-be16c054-ee75-4b43-b250-f4edfefe817f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.231126 Aug 24 08:56:25.024292 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2f067309-fd20-4c5d-87ac-69bc249f612b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.197361 Aug 24 08:56:25.024766 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 62/121] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:24 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:25.026352 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 60/122] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:24 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:25.029934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a9934112-d893-4a9e-9e15-ea8c074d9ba8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:25.030553 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a9934112-d893-4a9e-9e15-ea8c074d9ba8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:25.037888 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9934112-d893-4a9e-9e15-ea8c074d9ba8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:25.038364 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9934112-d893-4a9e-9e15-ea8c074d9ba8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:25.038806 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9934112-d893-4a9e-9e15-ea8c074d9ba8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.039536 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9934112-d893-4a9e-9e15-ea8c074d9ba8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:25.039972 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9934112-d893-4a9e-9e15-ea8c074d9ba8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:25.040672 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9934112-d893-4a9e-9e15-ea8c074d9ba8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.189123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-99f9cce2-f759-4f7e-a682-961dde29a174 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:25.190261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-99f9cce2-f759-4f7e-a682-961dde29a174 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:25.202412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-99f9cce2-f759-4f7e-a682-961dde29a174 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:25.208368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-99f9cce2-f759-4f7e-a682-961dde29a174 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:25.208368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-99f9cce2-f759-4f7e-a682-961dde29a174 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.208368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-99f9cce2-f759-4f7e-a682-961dde29a174 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:25.208876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a9934112-d893-4a9e-9e15-ea8c074d9ba8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.208981 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-99f9cce2-f759-4f7e-a682-961dde29a174 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:25.208981 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-99f9cce2-f759-4f7e-a682-961dde29a174 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.211762 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:25.218097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a9934112-d893-4a9e-9e15-ea8c074d9ba8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.191922 Aug 24 08:56:25.218701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 63/123] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:25 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:25.361026 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-99f9cce2-f759-4f7e-a682-961dde29a174 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.369733 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-99f9cce2-f759-4f7e-a682-961dde29a174 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.187913 Aug 24 08:56:25.370331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 61/124] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:25 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:25.424380 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f5154e5c-36af-4aad-be6e-483c295a26a1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:25.425029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f5154e5c-36af-4aad-be6e-483c295a26a1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:25.432386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f5154e5c-36af-4aad-be6e-483c295a26a1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:25.432912 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f5154e5c-36af-4aad-be6e-483c295a26a1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:25.433342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f5154e5c-36af-4aad-be6e-483c295a26a1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.434042 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f5154e5c-36af-4aad-be6e-483c295a26a1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:25.434483 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f5154e5c-36af-4aad-be6e-483c295a26a1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:25.434904 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f5154e5c-36af-4aad-be6e-483c295a26a1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.584234 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f5154e5c-36af-4aad-be6e-483c295a26a1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.595699 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f5154e5c-36af-4aad-be6e-483c295a26a1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.597396 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f5154e5c-36af-4aad-be6e-483c295a26a1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.599571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f5154e5c-36af-4aad-be6e-483c295a26a1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.179901 Aug 24 08:56:25.600058 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 64/125] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:25 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:26.051969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5c746c54-dee9-425e-92b5-0039357f5e10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:26.053183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5c746c54-dee9-425e-92b5-0039357f5e10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:26.062931 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-68a2159a-6155-434a-b151-1e33c3992356 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:26.063938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-68a2159a-6155-434a-b151-1e33c3992356 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:26.064089 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5c746c54-dee9-425e-92b5-0039357f5e10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.064799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5c746c54-dee9-425e-92b5-0039357f5e10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.065518 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5c746c54-dee9-425e-92b5-0039357f5e10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.066707 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5c746c54-dee9-425e-92b5-0039357f5e10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.068252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5c746c54-dee9-425e-92b5-0039357f5e10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.069031 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5c746c54-dee9-425e-92b5-0039357f5e10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.075102 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-68a2159a-6155-434a-b151-1e33c3992356 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.078876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-68a2159a-6155-434a-b151-1e33c3992356 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.078876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-68a2159a-6155-434a-b151-1e33c3992356 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.078876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-68a2159a-6155-434a-b151-1e33c3992356 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.079246 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-68a2159a-6155-434a-b151-1e33c3992356 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.079877 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-68a2159a-6155-434a-b151-1e33c3992356 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.281600 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-68a2159a-6155-434a-b151-1e33c3992356 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:26.289855 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5c746c54-dee9-425e-92b5-0039357f5e10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:26.290700 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-68a2159a-6155-434a-b151-1e33c3992356 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.234992 Aug 24 08:56:26.305154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5c746c54-dee9-425e-92b5-0039357f5e10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.257574 Aug 24 08:56:26.305496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 65/126] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:26 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:26.310258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-815d0ca2-396a-4350-8782-f48ec5ba3f7b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:26.311003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-815d0ca2-396a-4350-8782-f48ec5ba3f7b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:26.317972 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-815d0ca2-396a-4350-8782-f48ec5ba3f7b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.318429 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 62/127] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:26 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:26.318572 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-815d0ca2-396a-4350-8782-f48ec5ba3f7b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.318978 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-815d0ca2-396a-4350-8782-f48ec5ba3f7b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.319587 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-815d0ca2-396a-4350-8782-f48ec5ba3f7b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.320040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-815d0ca2-396a-4350-8782-f48ec5ba3f7b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.320464 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-815d0ca2-396a-4350-8782-f48ec5ba3f7b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.392120 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b1d2837b-5277-4717-894d-413b6549c094 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:26.393244 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b1d2837b-5277-4717-894d-413b6549c094 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:26.403765 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b1d2837b-5277-4717-894d-413b6549c094 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.404939 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b1d2837b-5277-4717-894d-413b6549c094 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.405584 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b1d2837b-5277-4717-894d-413b6549c094 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.406569 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b1d2837b-5277-4717-894d-413b6549c094 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.407211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b1d2837b-5277-4717-894d-413b6549c094 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.408150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b1d2837b-5277-4717-894d-413b6549c094 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.489575 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-815d0ca2-396a-4350-8782-f48ec5ba3f7b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:26.500144 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-815d0ca2-396a-4350-8782-f48ec5ba3f7b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.193612 Aug 24 08:56:26.507134 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 66/128] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:26 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:26.578900 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b1d2837b-5277-4717-894d-413b6549c094 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:26.587344 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b1d2837b-5277-4717-894d-413b6549c094 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.199520 Aug 24 08:56:26.587929 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 63/129] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:26 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:26.626921 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fe1aad6a-e9fd-4472-a4fc-b6e35b8de5c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:26.627539 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fe1aad6a-e9fd-4472-a4fc-b6e35b8de5c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:26.634879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe1aad6a-e9fd-4472-a4fc-b6e35b8de5c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.635376 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe1aad6a-e9fd-4472-a4fc-b6e35b8de5c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.635813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe1aad6a-e9fd-4472-a4fc-b6e35b8de5c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.636553 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe1aad6a-e9fd-4472-a4fc-b6e35b8de5c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.637019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe1aad6a-e9fd-4472-a4fc-b6e35b8de5c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.637445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe1aad6a-e9fd-4472-a4fc-b6e35b8de5c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.796204 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fe1aad6a-e9fd-4472-a4fc-b6e35b8de5c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:26.806032 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fe1aad6a-e9fd-4472-a4fc-b6e35b8de5c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:26.807631 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fe1aad6a-e9fd-4472-a4fc-b6e35b8de5c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:26.808817 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fe1aad6a-e9fd-4472-a4fc-b6e35b8de5c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.185805 Aug 24 08:56:26.809383 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 67/130] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:26 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:27.311764 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f7580280-0521-424b-aea1-108ea8540467 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:27.317150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f7580280-0521-424b-aea1-108ea8540467 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:27.319288 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f7580280-0521-424b-aea1-108ea8540467 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.319831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f7580280-0521-424b-aea1-108ea8540467 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.320331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f7580280-0521-424b-aea1-108ea8540467 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.321134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f7580280-0521-424b-aea1-108ea8540467 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.321689 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f7580280-0521-424b-aea1-108ea8540467 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.322159 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f7580280-0521-424b-aea1-108ea8540467 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.327095 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:27.343348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-76d0ff06-20a3-44ab-a3eb-59491621dee8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:27.344410 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-76d0ff06-20a3-44ab-a3eb-59491621dee8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:27.352452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-76d0ff06-20a3-44ab-a3eb-59491621dee8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.353219 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-76d0ff06-20a3-44ab-a3eb-59491621dee8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.353748 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-76d0ff06-20a3-44ab-a3eb-59491621dee8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.354563 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-76d0ff06-20a3-44ab-a3eb-59491621dee8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.355110 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-76d0ff06-20a3-44ab-a3eb-59491621dee8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.355616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-76d0ff06-20a3-44ab-a3eb-59491621dee8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.513351 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f7580280-0521-424b-aea1-108ea8540467 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:27.525261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f7580280-0521-424b-aea1-108ea8540467 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.217374 Aug 24 08:56:27.526026 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 64/131] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:27 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:27.534746 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-efbafe1f-740d-4791-be1c-daadfc76be9c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:27.536258 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-efbafe1f-740d-4791-be1c-daadfc76be9c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:27.548659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efbafe1f-740d-4791-be1c-daadfc76be9c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.549566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efbafe1f-740d-4791-be1c-daadfc76be9c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.550372 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efbafe1f-740d-4791-be1c-daadfc76be9c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.551447 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efbafe1f-740d-4791-be1c-daadfc76be9c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.552008 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efbafe1f-740d-4791-be1c-daadfc76be9c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.552578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efbafe1f-740d-4791-be1c-daadfc76be9c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.568080 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-76d0ff06-20a3-44ab-a3eb-59491621dee8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:27.576260 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-76d0ff06-20a3-44ab-a3eb-59491621dee8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.238765 Aug 24 08:56:27.576893 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 68/132] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:27 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:27.609215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f72f8074-5492-4ba6-8cf1-dc98600684cb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:27.610492 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f72f8074-5492-4ba6-8cf1-dc98600684cb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:27.618985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f72f8074-5492-4ba6-8cf1-dc98600684cb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.619572 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f72f8074-5492-4ba6-8cf1-dc98600684cb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.620136 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f72f8074-5492-4ba6-8cf1-dc98600684cb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.621123 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f72f8074-5492-4ba6-8cf1-dc98600684cb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.621655 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f72f8074-5492-4ba6-8cf1-dc98600684cb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.622121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f72f8074-5492-4ba6-8cf1-dc98600684cb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.725264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-efbafe1f-740d-4791-be1c-daadfc76be9c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:27.736900 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-efbafe1f-740d-4791-be1c-daadfc76be9c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.209386 Aug 24 08:56:27.737754 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 65/133] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:27 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:27.798430 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f72f8074-5492-4ba6-8cf1-dc98600684cb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:27.806959 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f72f8074-5492-4ba6-8cf1-dc98600684cb tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.202005 Aug 24 08:56:27.807577 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 69/134] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:27 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:27.831904 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-665be152-2d17-4e13-9e4b-bbbae88831da tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:27.835301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-665be152-2d17-4e13-9e4b-bbbae88831da tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:27.836169 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:27.839894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-665be152-2d17-4e13-9e4b-bbbae88831da tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.840377 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-665be152-2d17-4e13-9e4b-bbbae88831da tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.840845 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-665be152-2d17-4e13-9e4b-bbbae88831da tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.841564 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-665be152-2d17-4e13-9e4b-bbbae88831da tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.842017 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-665be152-2d17-4e13-9e4b-bbbae88831da tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.842439 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-665be152-2d17-4e13-9e4b-bbbae88831da tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.041786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-665be152-2d17-4e13-9e4b-bbbae88831da tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:28.051035 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-665be152-2d17-4e13-9e4b-bbbae88831da tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:28.052589 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-665be152-2d17-4e13-9e4b-bbbae88831da tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:28.053743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-665be152-2d17-4e13-9e4b-bbbae88831da tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.225961 Aug 24 08:56:28.054318 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 66/135] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:27 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:28.558904 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-62cc6d22-8218-4c64-9b11-c0a0783c47bf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:28.559747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-62cc6d22-8218-4c64-9b11-c0a0783c47bf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:28.566155 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62cc6d22-8218-4c64-9b11-c0a0783c47bf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.566640 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62cc6d22-8218-4c64-9b11-c0a0783c47bf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.567741 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62cc6d22-8218-4c64-9b11-c0a0783c47bf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.568454 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62cc6d22-8218-4c64-9b11-c0a0783c47bf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.569072 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62cc6d22-8218-4c64-9b11-c0a0783c47bf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.569487 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62cc6d22-8218-4c64-9b11-c0a0783c47bf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.617804 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d1d809ee-dc40-4230-9fbe-54d9d8cf6852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:28.618943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d1d809ee-dc40-4230-9fbe-54d9d8cf6852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:28.630784 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d1d809ee-dc40-4230-9fbe-54d9d8cf6852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.631760 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d1d809ee-dc40-4230-9fbe-54d9d8cf6852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.632564 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d1d809ee-dc40-4230-9fbe-54d9d8cf6852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.634086 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d1d809ee-dc40-4230-9fbe-54d9d8cf6852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.634936 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d1d809ee-dc40-4230-9fbe-54d9d8cf6852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.635696 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d1d809ee-dc40-4230-9fbe-54d9d8cf6852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.731177 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-62cc6d22-8218-4c64-9b11-c0a0783c47bf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:28.746101 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-62cc6d22-8218-4c64-9b11-c0a0783c47bf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.190915 Aug 24 08:56:28.747276 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 70/136] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:28 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:28.761755 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b61bd7ea-bb4d-4e71-8f6c-dbebb8c15c73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:28.762816 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b61bd7ea-bb4d-4e71-8f6c-dbebb8c15c73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:28.771595 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b61bd7ea-bb4d-4e71-8f6c-dbebb8c15c73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.772317 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b61bd7ea-bb4d-4e71-8f6c-dbebb8c15c73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.772962 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b61bd7ea-bb4d-4e71-8f6c-dbebb8c15c73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.774373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b61bd7ea-bb4d-4e71-8f6c-dbebb8c15c73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.775075 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b61bd7ea-bb4d-4e71-8f6c-dbebb8c15c73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.775890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b61bd7ea-bb4d-4e71-8f6c-dbebb8c15c73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.861264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d1d809ee-dc40-4230-9fbe-54d9d8cf6852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:28.870676 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d1d809ee-dc40-4230-9fbe-54d9d8cf6852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.260456 Aug 24 08:56:28.871255 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 67/137] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:28 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:28.876282 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3dda9b8f-e775-49ec-a939-e5cfd9ce27bf tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:28.876920 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3dda9b8f-e775-49ec-a939-e5cfd9ce27bf tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:28.884023 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3dda9b8f-e775-49ec-a939-e5cfd9ce27bf tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.884367 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3dda9b8f-e775-49ec-a939-e5cfd9ce27bf tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.885068 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3dda9b8f-e775-49ec-a939-e5cfd9ce27bf tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.886269 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3dda9b8f-e775-49ec-a939-e5cfd9ce27bf tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.886731 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3dda9b8f-e775-49ec-a939-e5cfd9ce27bf tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.887150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3dda9b8f-e775-49ec-a939-e5cfd9ce27bf tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.972232 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b61bd7ea-bb4d-4e71-8f6c-dbebb8c15c73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:28.983534 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b61bd7ea-bb4d-4e71-8f6c-dbebb8c15c73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.227237 Aug 24 08:56:28.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 71/138] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:28 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:29.059328 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3dda9b8f-e775-49ec-a939-e5cfd9ce27bf tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:29.068165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3dda9b8f-e775-49ec-a939-e5cfd9ce27bf tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.195816 Aug 24 08:56:29.068905 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 68/139] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:28 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:29.078452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-403ea738-1b8c-4164-9544-b23dda6a8903 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:29.079163 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-403ea738-1b8c-4164-9544-b23dda6a8903 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:29.083197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:29.087578 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-403ea738-1b8c-4164-9544-b23dda6a8903 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.088125 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-403ea738-1b8c-4164-9544-b23dda6a8903 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.091002 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-403ea738-1b8c-4164-9544-b23dda6a8903 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.091002 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-403ea738-1b8c-4164-9544-b23dda6a8903 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.091002 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-403ea738-1b8c-4164-9544-b23dda6a8903 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.091002 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-403ea738-1b8c-4164-9544-b23dda6a8903 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.251589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-403ea738-1b8c-4164-9544-b23dda6a8903 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:29.261520 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-403ea738-1b8c-4164-9544-b23dda6a8903 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:29.263047 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-403ea738-1b8c-4164-9544-b23dda6a8903 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:29.264265 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-403ea738-1b8c-4164-9544-b23dda6a8903 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.191243 Aug 24 08:56:29.264885 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 72/140] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:29 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:29.778588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-91fbcc6b-85aa-42de-8e11-e3e21e7f3857 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:29.779366 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-91fbcc6b-85aa-42de-8e11-e3e21e7f3857 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:29.786765 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-91fbcc6b-85aa-42de-8e11-e3e21e7f3857 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.787264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-91fbcc6b-85aa-42de-8e11-e3e21e7f3857 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.787700 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-91fbcc6b-85aa-42de-8e11-e3e21e7f3857 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.788417 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-91fbcc6b-85aa-42de-8e11-e3e21e7f3857 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.789043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-91fbcc6b-85aa-42de-8e11-e3e21e7f3857 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.789480 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-91fbcc6b-85aa-42de-8e11-e3e21e7f3857 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.902360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-727bda2e-cba2-43ff-9aee-4c7218c5aeec tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:29.903839 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-727bda2e-cba2-43ff-9aee-4c7218c5aeec tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:29.914375 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-727bda2e-cba2-43ff-9aee-4c7218c5aeec tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.915060 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-727bda2e-cba2-43ff-9aee-4c7218c5aeec tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.915637 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-727bda2e-cba2-43ff-9aee-4c7218c5aeec tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.916588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-727bda2e-cba2-43ff-9aee-4c7218c5aeec tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.917304 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-727bda2e-cba2-43ff-9aee-4c7218c5aeec tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.918159 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-727bda2e-cba2-43ff-9aee-4c7218c5aeec tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.999568 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-91fbcc6b-85aa-42de-8e11-e3e21e7f3857 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.010517 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-91fbcc6b-85aa-42de-8e11-e3e21e7f3857 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.236301 Aug 24 08:56:30.011460 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 69/141] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:29 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:30.017311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9e4d415f-0bc0-48fd-a0b4-96c5fa49f7ea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:30.018372 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9e4d415f-0bc0-48fd-a0b4-96c5fa49f7ea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:30.033809 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e4d415f-0bc0-48fd-a0b4-96c5fa49f7ea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:30.033809 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e4d415f-0bc0-48fd-a0b4-96c5fa49f7ea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:30.033809 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e4d415f-0bc0-48fd-a0b4-96c5fa49f7ea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:30.033809 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e4d415f-0bc0-48fd-a0b4-96c5fa49f7ea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:30.034515 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e4d415f-0bc0-48fd-a0b4-96c5fa49f7ea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:30.034515 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e4d415f-0bc0-48fd-a0b4-96c5fa49f7ea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:30.141523 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-727bda2e-cba2-43ff-9aee-4c7218c5aeec tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.156975 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-727bda2e-cba2-43ff-9aee-4c7218c5aeec tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.261698 Aug 24 08:56:30.158089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 73/142] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:29 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:30.167910 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-41d77667-a814-4453-9838-4635c3202907 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:30.169690 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-41d77667-a814-4453-9838-4635c3202907 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:30.180472 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41d77667-a814-4453-9838-4635c3202907 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:30.181342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41d77667-a814-4453-9838-4635c3202907 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:30.182114 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41d77667-a814-4453-9838-4635c3202907 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:30.183382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41d77667-a814-4453-9838-4635c3202907 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:30.184214 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41d77667-a814-4453-9838-4635c3202907 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:30.185014 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41d77667-a814-4453-9838-4635c3202907 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:30.206839 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:30.246365 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9e4d415f-0bc0-48fd-a0b4-96c5fa49f7ea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.255455 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9e4d415f-0bc0-48fd-a0b4-96c5fa49f7ea tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.242502 Aug 24 08:56:30.256054 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 70/143] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:30 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:30.310539 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-72533fec-8b6a-42cd-8742-ecce9a4814bc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:30.311650 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-72533fec-8b6a-42cd-8742-ecce9a4814bc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:30.322868 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-72533fec-8b6a-42cd-8742-ecce9a4814bc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:30.323759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-72533fec-8b6a-42cd-8742-ecce9a4814bc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:30.324475 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-72533fec-8b6a-42cd-8742-ecce9a4814bc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:30.325759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-72533fec-8b6a-42cd-8742-ecce9a4814bc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:30.326667 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-72533fec-8b6a-42cd-8742-ecce9a4814bc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:30.327232 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-72533fec-8b6a-42cd-8742-ecce9a4814bc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:30.408604 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-41d77667-a814-4453-9838-4635c3202907 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.420514 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-41d77667-a814-4453-9838-4635c3202907 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.260124 Aug 24 08:56:30.427868 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 74/144] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:30 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:30.535491 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-72533fec-8b6a-42cd-8742-ecce9a4814bc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.545204 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-72533fec-8b6a-42cd-8742-ecce9a4814bc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.546878 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-72533fec-8b6a-42cd-8742-ecce9a4814bc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.548094 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-72533fec-8b6a-42cd-8742-ecce9a4814bc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.248656 Aug 24 08:56:30.548738 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 71/145] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:30 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:31.042836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-45bf4b58-606a-449a-9664-0a2da4ec1bc1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:31.045112 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-45bf4b58-606a-449a-9664-0a2da4ec1bc1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:31.072950 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-45bf4b58-606a-449a-9664-0a2da4ec1bc1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.072950 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-45bf4b58-606a-449a-9664-0a2da4ec1bc1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.074960 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-45bf4b58-606a-449a-9664-0a2da4ec1bc1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.077246 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-45bf4b58-606a-449a-9664-0a2da4ec1bc1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.078493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-45bf4b58-606a-449a-9664-0a2da4ec1bc1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.083045 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-45bf4b58-606a-449a-9664-0a2da4ec1bc1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.191272 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ecf2266e-b48a-46ae-b384-b163db12b749 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:31.192001 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ecf2266e-b48a-46ae-b384-b163db12b749 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:31.205212 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ecf2266e-b48a-46ae-b384-b163db12b749 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.208501 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ecf2266e-b48a-46ae-b384-b163db12b749 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.212212 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ecf2266e-b48a-46ae-b384-b163db12b749 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.215950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ecf2266e-b48a-46ae-b384-b163db12b749 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.217789 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ecf2266e-b48a-46ae-b384-b163db12b749 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.225675 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ecf2266e-b48a-46ae-b384-b163db12b749 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.572027 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-45bf4b58-606a-449a-9664-0a2da4ec1bc1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:31.604033 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-45bf4b58-606a-449a-9664-0a2da4ec1bc1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.572541 Aug 24 08:56:31.605955 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 75/146] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:31 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:31.621200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5e8199f9-2ebf-4ee5-8f6f-247e44e792ee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:31.627851 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5e8199f9-2ebf-4ee5-8f6f-247e44e792ee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:31.637598 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5e8199f9-2ebf-4ee5-8f6f-247e44e792ee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.638552 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5e8199f9-2ebf-4ee5-8f6f-247e44e792ee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.639535 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5e8199f9-2ebf-4ee5-8f6f-247e44e792ee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.642678 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5e8199f9-2ebf-4ee5-8f6f-247e44e792ee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.643667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5e8199f9-2ebf-4ee5-8f6f-247e44e792ee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.644480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5e8199f9-2ebf-4ee5-8f6f-247e44e792ee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.862313 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ecf2266e-b48a-46ae-b384-b163db12b749 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:31.872257 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ecf2266e-b48a-46ae-b384-b163db12b749 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.684258 Aug 24 08:56:31.873622 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 72/147] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:31 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:31.880190 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9de1659f-1e4d-4240-9a8a-9136e1bbecb9 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:31.881311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9de1659f-1e4d-4240-9a8a-9136e1bbecb9 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:31.888232 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9de1659f-1e4d-4240-9a8a-9136e1bbecb9 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.889228 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9de1659f-1e4d-4240-9a8a-9136e1bbecb9 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.889913 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9de1659f-1e4d-4240-9a8a-9136e1bbecb9 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.890880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9de1659f-1e4d-4240-9a8a-9136e1bbecb9 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.891564 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9de1659f-1e4d-4240-9a8a-9136e1bbecb9 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.892224 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9de1659f-1e4d-4240-9a8a-9136e1bbecb9 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.896765 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5e8199f9-2ebf-4ee5-8f6f-247e44e792ee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:31.927599 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5e8199f9-2ebf-4ee5-8f6f-247e44e792ee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.317465 Aug 24 08:56:31.945262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 76/148] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:31 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:31.953248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ea49c102-b7dc-463f-9f4f-5a08bb58bd3b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:31.954059 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ea49c102-b7dc-463f-9f4f-5a08bb58bd3b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:31.962691 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ea49c102-b7dc-463f-9f4f-5a08bb58bd3b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.963478 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ea49c102-b7dc-463f-9f4f-5a08bb58bd3b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.964620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ea49c102-b7dc-463f-9f4f-5a08bb58bd3b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.965619 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ea49c102-b7dc-463f-9f4f-5a08bb58bd3b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.966206 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ea49c102-b7dc-463f-9f4f-5a08bb58bd3b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.966745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ea49c102-b7dc-463f-9f4f-5a08bb58bd3b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:32.459283 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ea49c102-b7dc-463f-9f4f-5a08bb58bd3b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:32.481210 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ea49c102-b7dc-463f-9f4f-5a08bb58bd3b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:32.486254 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ea49c102-b7dc-463f-9f4f-5a08bb58bd3b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:32.489464 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ea49c102-b7dc-463f-9f4f-5a08bb58bd3b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.541903 Aug 24 08:56:32.505786 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 77/149] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:31 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:32.654183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ca58ab00-8043-46f3-a3be-8aea6c18ca43 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:32.657360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ca58ab00-8043-46f3-a3be-8aea6c18ca43 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:32.675384 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ca58ab00-8043-46f3-a3be-8aea6c18ca43 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:32.676517 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ca58ab00-8043-46f3-a3be-8aea6c18ca43 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:32.677741 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ca58ab00-8043-46f3-a3be-8aea6c18ca43 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:32.679059 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ca58ab00-8043-46f3-a3be-8aea6c18ca43 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:32.679913 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ca58ab00-8043-46f3-a3be-8aea6c18ca43 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:32.682288 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ca58ab00-8043-46f3-a3be-8aea6c18ca43 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:32.722973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9de1659f-1e4d-4240-9a8a-9136e1bbecb9 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:32.740978 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9de1659f-1e4d-4240-9a8a-9136e1bbecb9 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.865546 Aug 24 08:56:32.746797 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 73/150] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:31 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:32.884588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-e5d871a9-82f2-48db-ad82-fb6a3fdc33b7 req-780bbad0-651c-4b2f-9eda-1dade866909f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635351cd-1139-4659-9d13-086372a9af7c", "tag": "4ab0306a-2019-48d9-9e7f-8476d77391d3"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:32.896958 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e5d871a9-82f2-48db-ad82-fb6a3fdc33b7 req-780bbad0-651c-4b2f-9eda-1dade866909f service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:32.897522 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e5d871a9-82f2-48db-ad82-fb6a3fdc33b7 req-780bbad0-651c-4b2f-9eda-1dade866909f service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:32.897764 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e5d871a9-82f2-48db-ad82-fb6a3fdc33b7 req-780bbad0-651c-4b2f-9eda-1dade866909f service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:32.911976 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-e5d871a9-82f2-48db-ad82-fb6a3fdc33b7 req-780bbad0-651c-4b2f-9eda-1dade866909f service nova] Creating event network-changed:4ab0306a-2019-48d9-9e7f-8476d77391d3 for instance 635351cd-1139-4659-9d13-086372a9af7c on hv-cinder-85221 Aug 24 08:56:32.918319 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-e5d871a9-82f2-48db-ad82-fb6a3fdc33b7 req-780bbad0-651c-4b2f-9eda-1dade866909f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039205 Aug 24 08:56:32.923517 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 74/151] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:56:32.925249 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-718bae49-bdd3-426a-b055-a1b83d676ba5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:32.926391 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-718bae49-bdd3-426a-b055-a1b83d676ba5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:32.936703 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-718bae49-bdd3-426a-b055-a1b83d676ba5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:32.937572 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-718bae49-bdd3-426a-b055-a1b83d676ba5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:32.938264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-718bae49-bdd3-426a-b055-a1b83d676ba5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:32.939785 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-718bae49-bdd3-426a-b055-a1b83d676ba5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:32.940729 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-718bae49-bdd3-426a-b055-a1b83d676ba5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:32.941401 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-718bae49-bdd3-426a-b055-a1b83d676ba5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.037403 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ca58ab00-8043-46f3-a3be-8aea6c18ca43 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:33.058241 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ca58ab00-8043-46f3-a3be-8aea6c18ca43 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.416752 Aug 24 08:56:33.059432 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 78/152] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:32 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:33.066315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-20f2d7ab-6532-47cd-b6a5-4150f41e5398 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:33.067712 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-20f2d7ab-6532-47cd-b6a5-4150f41e5398 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:33.075835 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-20f2d7ab-6532-47cd-b6a5-4150f41e5398 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.076641 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-20f2d7ab-6532-47cd-b6a5-4150f41e5398 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.077237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-20f2d7ab-6532-47cd-b6a5-4150f41e5398 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.078224 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-20f2d7ab-6532-47cd-b6a5-4150f41e5398 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.079008 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-20f2d7ab-6532-47cd-b6a5-4150f41e5398 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.081018 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-20f2d7ab-6532-47cd-b6a5-4150f41e5398 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.349018 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-20f2d7ab-6532-47cd-b6a5-4150f41e5398 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:33.365427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-20f2d7ab-6532-47cd-b6a5-4150f41e5398 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.304368 Aug 24 08:56:33.366534 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 79/153] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:33 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:33.531861 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-63f67083-a8eb-4810-94ac-26d843e901c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:33.533119 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-63f67083-a8eb-4810-94ac-26d843e901c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:33.541341 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-63f67083-a8eb-4810-94ac-26d843e901c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.542276 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-63f67083-a8eb-4810-94ac-26d843e901c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.542764 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-63f67083-a8eb-4810-94ac-26d843e901c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.543947 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-63f67083-a8eb-4810-94ac-26d843e901c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.544487 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-63f67083-a8eb-4810-94ac-26d843e901c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.545188 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-63f67083-a8eb-4810-94ac-26d843e901c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.569830 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:33.753457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-63f67083-a8eb-4810-94ac-26d843e901c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:33.769605 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-63f67083-a8eb-4810-94ac-26d843e901c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:33.775950 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-63f67083-a8eb-4810-94ac-26d843e901c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:33.780570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-63f67083-a8eb-4810-94ac-26d843e901c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.255302 Aug 24 08:56:33.781553 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 80/154] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:33 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:33.797173 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-112f5f69-f292-4f1f-8b3f-abf6d0ef4fd2 req-b5289079-b319-4d28-9170-c1484ddcbbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abdb5828-315b-4046-9985-95e58a2f24b3", "tag": "756cdfb7-826d-4039-9977-c15d62078dd5"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:33.827712 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-112f5f69-f292-4f1f-8b3f-abf6d0ef4fd2 req-b5289079-b319-4d28-9170-c1484ddcbbc2 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.833428 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-112f5f69-f292-4f1f-8b3f-abf6d0ef4fd2 req-b5289079-b319-4d28-9170-c1484ddcbbc2 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.834226 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-112f5f69-f292-4f1f-8b3f-abf6d0ef4fd2 req-b5289079-b319-4d28-9170-c1484ddcbbc2 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.842333 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-718bae49-bdd3-426a-b055-a1b83d676ba5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:33.855506 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-718bae49-bdd3-426a-b055-a1b83d676ba5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.934873 Aug 24 08:56:33.856106 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 75/155] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:32 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:33.868452 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5f1d6cf0-f40e-4ccc-ae84-f21b2519e2dd tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:33.869548 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5f1d6cf0-f40e-4ccc-ae84-f21b2519e2dd tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:33.872373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-112f5f69-f292-4f1f-8b3f-abf6d0ef4fd2 req-b5289079-b319-4d28-9170-c1484ddcbbc2 service nova] Creating event network-changed:756cdfb7-826d-4039-9977-c15d62078dd5 for instance abdb5828-315b-4046-9985-95e58a2f24b3 on hv-cinder-85221 Aug 24 08:56:33.885859 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f1d6cf0-f40e-4ccc-ae84-f21b2519e2dd tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.886329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f1d6cf0-f40e-4ccc-ae84-f21b2519e2dd tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.888757 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f1d6cf0-f40e-4ccc-ae84-f21b2519e2dd tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.891118 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f1d6cf0-f40e-4ccc-ae84-f21b2519e2dd tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.891742 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f1d6cf0-f40e-4ccc-ae84-f21b2519e2dd tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.892251 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f1d6cf0-f40e-4ccc-ae84-f21b2519e2dd tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.892700 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-112f5f69-f292-4f1f-8b3f-abf6d0ef4fd2 req-b5289079-b319-4d28-9170-c1484ddcbbc2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105126 Aug 24 08:56:33.893788 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 81/156] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:34.111402 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-bbca1734-7789-438f-b18c-a78646e4c6a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:34.114645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-bbca1734-7789-438f-b18c-a78646e4c6a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:34.131063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbca1734-7789-438f-b18c-a78646e4c6a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:34.133198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbca1734-7789-438f-b18c-a78646e4c6a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:34.134157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbca1734-7789-438f-b18c-a78646e4c6a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:34.136200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbca1734-7789-438f-b18c-a78646e4c6a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:34.138038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbca1734-7789-438f-b18c-a78646e4c6a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:34.138823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbca1734-7789-438f-b18c-a78646e4c6a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:34.329169 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5f1d6cf0-f40e-4ccc-ae84-f21b2519e2dd tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:34.339587 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5f1d6cf0-f40e-4ccc-ae84-f21b2519e2dd tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.481105 Aug 24 08:56:34.341373 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 76/157] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:33 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:34.416856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-042fcf67-3d9f-413f-986b-aecf61155340 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:34.418234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-042fcf67-3d9f-413f-986b-aecf61155340 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:34.446433 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-042fcf67-3d9f-413f-986b-aecf61155340 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:34.460723 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-042fcf67-3d9f-413f-986b-aecf61155340 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:34.460723 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-042fcf67-3d9f-413f-986b-aecf61155340 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:34.460723 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-042fcf67-3d9f-413f-986b-aecf61155340 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:34.460723 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-042fcf67-3d9f-413f-986b-aecf61155340 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:34.461244 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-042fcf67-3d9f-413f-986b-aecf61155340 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:34.781095 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-bbca1734-7789-438f-b18c-a78646e4c6a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:34.797486 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-bbca1734-7789-438f-b18c-a78646e4c6a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.695999 Aug 24 08:56:34.799497 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 82/158] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:34 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:34.830122 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5500297a-5454-401b-9d5a-4cdda1076f1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:34.832190 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5500297a-5454-401b-9d5a-4cdda1076f1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:34.844239 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5500297a-5454-401b-9d5a-4cdda1076f1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:34.845744 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5500297a-5454-401b-9d5a-4cdda1076f1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:34.846915 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5500297a-5454-401b-9d5a-4cdda1076f1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:34.848764 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5500297a-5454-401b-9d5a-4cdda1076f1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:34.850041 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5500297a-5454-401b-9d5a-4cdda1076f1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:34.851123 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5500297a-5454-401b-9d5a-4cdda1076f1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:35.287104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5500297a-5454-401b-9d5a-4cdda1076f1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:35.305950 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5500297a-5454-401b-9d5a-4cdda1076f1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:35.310518 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5500297a-5454-401b-9d5a-4cdda1076f1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:35.313423 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5500297a-5454-401b-9d5a-4cdda1076f1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.492753 Aug 24 08:56:35.315441 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 83/159] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:34 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:35.325205 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fc09cfa4-4c12-410a-ab66-7a31d3b44761 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:35.326843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fc09cfa4-4c12-410a-ab66-7a31d3b44761 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:35.344879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fc09cfa4-4c12-410a-ab66-7a31d3b44761 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:35.346435 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fc09cfa4-4c12-410a-ab66-7a31d3b44761 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:35.349256 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fc09cfa4-4c12-410a-ab66-7a31d3b44761 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:35.352130 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fc09cfa4-4c12-410a-ab66-7a31d3b44761 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:35.354555 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fc09cfa4-4c12-410a-ab66-7a31d3b44761 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:35.355798 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fc09cfa4-4c12-410a-ab66-7a31d3b44761 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:35.884175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fc09cfa4-4c12-410a-ab66-7a31d3b44761 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:35.916590 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fc09cfa4-4c12-410a-ab66-7a31d3b44761 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.596269 Aug 24 08:56:35.919444 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 84/160] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:35 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:35.935945 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b7947a37-74eb-4b48-b9a7-c32f1746bbe2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:35.936653 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b7947a37-74eb-4b48-b9a7-c32f1746bbe2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:35.944168 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b7947a37-74eb-4b48-b9a7-c32f1746bbe2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:35.945015 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b7947a37-74eb-4b48-b9a7-c32f1746bbe2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:35.945618 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b7947a37-74eb-4b48-b9a7-c32f1746bbe2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:35.948719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b7947a37-74eb-4b48-b9a7-c32f1746bbe2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:35.949482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b7947a37-74eb-4b48-b9a7-c32f1746bbe2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:35.950113 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b7947a37-74eb-4b48-b9a7-c32f1746bbe2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.056843 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-042fcf67-3d9f-413f-986b-aecf61155340 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:36.068087 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-042fcf67-3d9f-413f-986b-aecf61155340 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 1.664727 Aug 24 08:56:36.069402 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 77/161] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:34 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:36.160580 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-79d18415-2cb1-4f43-aa4b-50234723230f req-1ec783f2-15ae-4409-a8b1-f84f1caee811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e80c6c-b61f-42b6-9c29-cf86c7099e57", "name": "network-vif-plugged", "status": "completed", "tag": "08f182dc-1537-4524-ac71-00ff617d64ef"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:36.174611 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-79d18415-2cb1-4f43-aa4b-50234723230f req-1ec783f2-15ae-4409-a8b1-f84f1caee811 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.175467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-79d18415-2cb1-4f43-aa4b-50234723230f req-1ec783f2-15ae-4409-a8b1-f84f1caee811 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.176174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-79d18415-2cb1-4f43-aa4b-50234723230f req-1ec783f2-15ae-4409-a8b1-f84f1caee811 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.190994 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-79d18415-2cb1-4f43-aa4b-50234723230f req-1ec783f2-15ae-4409-a8b1-f84f1caee811 service nova] Creating event network-vif-plugged:08f182dc-1537-4524-ac71-00ff617d64ef for instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 on hv-cinder-85221 Aug 24 08:56:36.198570 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-79d18415-2cb1-4f43-aa4b-50234723230f req-1ec783f2-15ae-4409-a8b1-f84f1caee811 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127451 Aug 24 08:56:36.204152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 78/162] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:36.209045 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2dd67c44-c8bd-4208-980e-b762444b2dfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:36.209849 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2dd67c44-c8bd-4208-980e-b762444b2dfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:36.220633 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2dd67c44-c8bd-4208-980e-b762444b2dfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.221322 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2dd67c44-c8bd-4208-980e-b762444b2dfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.221864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2dd67c44-c8bd-4208-980e-b762444b2dfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.222591 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2dd67c44-c8bd-4208-980e-b762444b2dfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.223650 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2dd67c44-c8bd-4208-980e-b762444b2dfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.224395 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2dd67c44-c8bd-4208-980e-b762444b2dfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.229561 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b7947a37-74eb-4b48-b9a7-c32f1746bbe2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:36.244644 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b7947a37-74eb-4b48-b9a7-c32f1746bbe2 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.322015 Aug 24 08:56:36.265878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 85/163] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:35 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:36.282655 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-722a15d3-b499-44b2-9ca3-82ba122da3ac req-5407f394-56a4-4766-b97a-dc482b66419e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a46236b-ed03-4f8e-8eba-3d04a06056a1", "tag": "53dc34cd-6619-41da-8d76-3a1724dbcce6"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:36.298909 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-722a15d3-b499-44b2-9ca3-82ba122da3ac req-5407f394-56a4-4766-b97a-dc482b66419e service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.299599 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-722a15d3-b499-44b2-9ca3-82ba122da3ac req-5407f394-56a4-4766-b97a-dc482b66419e service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.300264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-722a15d3-b499-44b2-9ca3-82ba122da3ac req-5407f394-56a4-4766-b97a-dc482b66419e service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.317394 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-722a15d3-b499-44b2-9ca3-82ba122da3ac req-5407f394-56a4-4766-b97a-dc482b66419e service nova] Creating event network-changed:53dc34cd-6619-41da-8d76-3a1724dbcce6 for instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 on hv-cinder-85221 Aug 24 08:56:36.325008 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-722a15d3-b499-44b2-9ca3-82ba122da3ac req-5407f394-56a4-4766-b97a-dc482b66419e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056543 Aug 24 08:56:36.325940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 86/164] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:36.339437 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ab72740b-8c8b-41c3-99f7-4bcfd09c6bc9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:36.340257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ab72740b-8c8b-41c3-99f7-4bcfd09c6bc9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:36.348027 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ab72740b-8c8b-41c3-99f7-4bcfd09c6bc9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.350340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ab72740b-8c8b-41c3-99f7-4bcfd09c6bc9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.350340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ab72740b-8c8b-41c3-99f7-4bcfd09c6bc9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.350659 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ab72740b-8c8b-41c3-99f7-4bcfd09c6bc9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.350939 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ab72740b-8c8b-41c3-99f7-4bcfd09c6bc9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.351671 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ab72740b-8c8b-41c3-99f7-4bcfd09c6bc9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.507101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2dd67c44-c8bd-4208-980e-b762444b2dfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:36.521541 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2dd67c44-c8bd-4208-980e-b762444b2dfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.319903 Aug 24 08:56:36.525602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ab72740b-8c8b-41c3-99f7-4bcfd09c6bc9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:36.530410 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 79/165] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:36 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:36.536006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ab72740b-8c8b-41c3-99f7-4bcfd09c6bc9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:36.548754 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ab72740b-8c8b-41c3-99f7-4bcfd09c6bc9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:36.548754 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ab72740b-8c8b-41c3-99f7-4bcfd09c6bc9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.204935 Aug 24 08:56:36.548754 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 87/166] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:36 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:36.941544 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e34d8b9d-1cd3-4ace-8531-df5f7cf8811c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:36.942817 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e34d8b9d-1cd3-4ace-8531-df5f7cf8811c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:36.949547 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e34d8b9d-1cd3-4ace-8531-df5f7cf8811c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.966419 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e34d8b9d-1cd3-4ace-8531-df5f7cf8811c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.966419 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e34d8b9d-1cd3-4ace-8531-df5f7cf8811c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.966419 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e34d8b9d-1cd3-4ace-8531-df5f7cf8811c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.966419 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e34d8b9d-1cd3-4ace-8531-df5f7cf8811c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.967839 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e34d8b9d-1cd3-4ace-8531-df5f7cf8811c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.129288 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5848d7a8-1862-4be6-80c9-f867f041c12f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:37.137589 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e34d8b9d-1cd3-4ace-8531-df5f7cf8811c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.141781 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5848d7a8-1862-4be6-80c9-f867f041c12f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:37.154026 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e34d8b9d-1cd3-4ace-8531-df5f7cf8811c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.216110 Aug 24 08:56:37.156229 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 80/167] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:36 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:37.168610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5848d7a8-1862-4be6-80c9-f867f041c12f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.169397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5848d7a8-1862-4be6-80c9-f867f041c12f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.170207 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5848d7a8-1862-4be6-80c9-f867f041c12f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.171537 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5848d7a8-1862-4be6-80c9-f867f041c12f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.172372 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5848d7a8-1862-4be6-80c9-f867f041c12f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.173162 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5848d7a8-1862-4be6-80c9-f867f041c12f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.288413 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-80ee2f63-890d-4994-8cf4-8c7dd404599b tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:37.289542 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-80ee2f63-890d-4994-8cf4-8c7dd404599b tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:37.300327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-80ee2f63-890d-4994-8cf4-8c7dd404599b tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.301238 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-80ee2f63-890d-4994-8cf4-8c7dd404599b tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.302008 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-80ee2f63-890d-4994-8cf4-8c7dd404599b tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.303446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-80ee2f63-890d-4994-8cf4-8c7dd404599b tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.304291 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-80ee2f63-890d-4994-8cf4-8c7dd404599b tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.305059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-80ee2f63-890d-4994-8cf4-8c7dd404599b tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.373354 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5848d7a8-1862-4be6-80c9-f867f041c12f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.383144 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5848d7a8-1862-4be6-80c9-f867f041c12f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.270078 Aug 24 08:56:37.388800 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 88/168] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:37 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:37.544812 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-80ee2f63-890d-4994-8cf4-8c7dd404599b tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.561517 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a62693bb-1059-4cd0-9bf5-e36ae9e7b489 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:37.562220 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-80ee2f63-890d-4994-8cf4-8c7dd404599b tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.280698 Aug 24 08:56:37.563267 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 81/169] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:37 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:37.563731 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a62693bb-1059-4cd0-9bf5-e36ae9e7b489 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:37.574281 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4bd1685b-87cf-469f-946f-2d64ec038bc5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:37.575517 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4bd1685b-87cf-469f-946f-2d64ec038bc5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:37.575874 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a62693bb-1059-4cd0-9bf5-e36ae9e7b489 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.577035 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a62693bb-1059-4cd0-9bf5-e36ae9e7b489 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.578063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a62693bb-1059-4cd0-9bf5-e36ae9e7b489 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.579878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a62693bb-1059-4cd0-9bf5-e36ae9e7b489 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.581787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a62693bb-1059-4cd0-9bf5-e36ae9e7b489 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.583005 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a62693bb-1059-4cd0-9bf5-e36ae9e7b489 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.593018 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4bd1685b-87cf-469f-946f-2d64ec038bc5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.593018 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4bd1685b-87cf-469f-946f-2d64ec038bc5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.596770 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4bd1685b-87cf-469f-946f-2d64ec038bc5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.598166 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4bd1685b-87cf-469f-946f-2d64ec038bc5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.598954 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4bd1685b-87cf-469f-946f-2d64ec038bc5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.599667 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4bd1685b-87cf-469f-946f-2d64ec038bc5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.617588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:37.882075 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a62693bb-1059-4cd0-9bf5-e36ae9e7b489 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.909545 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a62693bb-1059-4cd0-9bf5-e36ae9e7b489 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.355379 Aug 24 08:56:37.948092 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 89/170] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:37 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:37.951350 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4bd1685b-87cf-469f-946f-2d64ec038bc5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.963706 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4bd1685b-87cf-469f-946f-2d64ec038bc5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.966412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4bd1685b-87cf-469f-946f-2d64ec038bc5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.967934 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4bd1685b-87cf-469f-946f-2d64ec038bc5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.403129 Aug 24 08:56:37.971299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 82/171] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:37 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:38.189227 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e595d644-f010-47f4-908d-6e6cb22710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:38.189927 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e595d644-f010-47f4-908d-6e6cb22710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:38.196952 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e595d644-f010-47f4-908d-6e6cb22710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:38.197599 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e595d644-f010-47f4-908d-6e6cb22710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:38.197876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e595d644-f010-47f4-908d-6e6cb22710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:38.198603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e595d644-f010-47f4-908d-6e6cb22710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:38.199059 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e595d644-f010-47f4-908d-6e6cb22710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:38.199480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e595d644-f010-47f4-908d-6e6cb22710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:38.237450 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-a366a822-c259-46bc-89c1-d0f849fd58af req-56a578f8-1c1c-4b18-816b-331e3d46a2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1ec0c9-cd4b-4256-bc67-975c8dc732c3", "name": "network-vif-plugged", "status": "completed", "tag": "6c0c24ef-4f56-4e8d-9dfc-db756eb87f1b"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:38.250723 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-a366a822-c259-46bc-89c1-d0f849fd58af req-56a578f8-1c1c-4b18-816b-331e3d46a2eb service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:38.251198 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-a366a822-c259-46bc-89c1-d0f849fd58af req-56a578f8-1c1c-4b18-816b-331e3d46a2eb service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:38.251634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-a366a822-c259-46bc-89c1-d0f849fd58af req-56a578f8-1c1c-4b18-816b-331e3d46a2eb service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:38.264158 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-a366a822-c259-46bc-89c1-d0f849fd58af req-56a578f8-1c1c-4b18-816b-331e3d46a2eb service nova] Creating event network-vif-plugged:6c0c24ef-4f56-4e8d-9dfc-db756eb87f1b for instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 on hv-cinder-85221 Aug 24 08:56:38.271864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-a366a822-c259-46bc-89c1-d0f849fd58af req-56a578f8-1c1c-4b18-816b-331e3d46a2eb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041209 Aug 24 08:56:38.272831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 83/172] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:38.411123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5a413132-cc04-460b-ba73-02b1eadc31a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:38.411974 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5a413132-cc04-460b-ba73-02b1eadc31a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:38.427022 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5a413132-cc04-460b-ba73-02b1eadc31a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:38.429573 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5a413132-cc04-460b-ba73-02b1eadc31a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:38.430622 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5a413132-cc04-460b-ba73-02b1eadc31a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:38.435095 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e595d644-f010-47f4-908d-6e6cb22710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:38.435696 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5a413132-cc04-460b-ba73-02b1eadc31a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:38.436447 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5a413132-cc04-460b-ba73-02b1eadc31a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:38.437133 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5a413132-cc04-460b-ba73-02b1eadc31a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:38.458951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e595d644-f010-47f4-908d-6e6cb22710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.272323 Aug 24 08:56:38.462430 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 90/173] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:38 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:38.607675 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-12a41656-ebc3-4e3d-a3c6-fec190aa8c57 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:38.609401 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-12a41656-ebc3-4e3d-a3c6-fec190aa8c57 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:38.633239 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-12a41656-ebc3-4e3d-a3c6-fec190aa8c57 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:38.635436 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-12a41656-ebc3-4e3d-a3c6-fec190aa8c57 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:38.636682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-12a41656-ebc3-4e3d-a3c6-fec190aa8c57 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:38.638589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-12a41656-ebc3-4e3d-a3c6-fec190aa8c57 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:38.639444 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-12a41656-ebc3-4e3d-a3c6-fec190aa8c57 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:38.641790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-12a41656-ebc3-4e3d-a3c6-fec190aa8c57 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:39.066121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-12a41656-ebc3-4e3d-a3c6-fec190aa8c57 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:39.078172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-12a41656-ebc3-4e3d-a3c6-fec190aa8c57 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.479021 Aug 24 08:56:39.078779 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 91/174] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:38 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:39.100885 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0120cd29-caa9-49f7-9ac4-78f8af561e7b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:39.107004 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0120cd29-caa9-49f7-9ac4-78f8af561e7b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:39.123908 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0120cd29-caa9-49f7-9ac4-78f8af561e7b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:39.129729 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0120cd29-caa9-49f7-9ac4-78f8af561e7b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:39.129729 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0120cd29-caa9-49f7-9ac4-78f8af561e7b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:39.129729 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0120cd29-caa9-49f7-9ac4-78f8af561e7b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:39.129729 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0120cd29-caa9-49f7-9ac4-78f8af561e7b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:39.130464 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0120cd29-caa9-49f7-9ac4-78f8af561e7b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:39.407535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5a413132-cc04-460b-ba73-02b1eadc31a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:39.422989 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5a413132-cc04-460b-ba73-02b1eadc31a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 1.016945 Aug 24 08:56:39.424161 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 84/175] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:38 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:39.441252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f93df422-91a6-4ba2-8ba1-a61fbead4375 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:39.441920 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f93df422-91a6-4ba2-8ba1-a61fbead4375 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:39.455937 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f93df422-91a6-4ba2-8ba1-a61fbead4375 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:39.456450 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f93df422-91a6-4ba2-8ba1-a61fbead4375 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:39.456932 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f93df422-91a6-4ba2-8ba1-a61fbead4375 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:39.459864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f93df422-91a6-4ba2-8ba1-a61fbead4375 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:39.460365 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f93df422-91a6-4ba2-8ba1-a61fbead4375 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:39.460847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f93df422-91a6-4ba2-8ba1-a61fbead4375 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:39.665044 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0120cd29-caa9-49f7-9ac4-78f8af561e7b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:39.674187 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0120cd29-caa9-49f7-9ac4-78f8af561e7b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.578057 Aug 24 08:56:39.675684 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 92/176] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:39 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:39.695352 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-cd344ab3-ceaa-4c6e-98cc-7cbc1d573a53 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:39.696258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-cd344ab3-ceaa-4c6e-98cc-7cbc1d573a53 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:39.703544 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd344ab3-ceaa-4c6e-98cc-7cbc1d573a53 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:39.704040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd344ab3-ceaa-4c6e-98cc-7cbc1d573a53 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:39.704481 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd344ab3-ceaa-4c6e-98cc-7cbc1d573a53 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:39.706989 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd344ab3-ceaa-4c6e-98cc-7cbc1d573a53 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:39.706989 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd344ab3-ceaa-4c6e-98cc-7cbc1d573a53 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:39.707795 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd344ab3-ceaa-4c6e-98cc-7cbc1d573a53 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.003212 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-cd344ab3-ceaa-4c6e-98cc-7cbc1d573a53 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.016472 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-cd344ab3-ceaa-4c6e-98cc-7cbc1d573a53 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.337880 Aug 24 08:56:40.020473 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 93/177] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:39 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:40.108393 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-adf1c53f-0014-4b66-b575-fd3da70dd0b3 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:40.112868 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-adf1c53f-0014-4b66-b575-fd3da70dd0b3 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:40.125767 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-adf1c53f-0014-4b66-b575-fd3da70dd0b3 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.128350 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-adf1c53f-0014-4b66-b575-fd3da70dd0b3 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.129787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-adf1c53f-0014-4b66-b575-fd3da70dd0b3 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.131312 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-adf1c53f-0014-4b66-b575-fd3da70dd0b3 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.132512 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-adf1c53f-0014-4b66-b575-fd3da70dd0b3 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.133578 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-adf1c53f-0014-4b66-b575-fd3da70dd0b3 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.374864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-adf1c53f-0014-4b66-b575-fd3da70dd0b3 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.394047 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-adf1c53f-0014-4b66-b575-fd3da70dd0b3 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.296005 Aug 24 08:56:40.410341 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 94/178] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:40 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:40.468223 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a209164b-2d48-42ff-9248-d6b668e0d1ae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:40.471110 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a209164b-2d48-42ff-9248-d6b668e0d1ae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:40.486095 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a209164b-2d48-42ff-9248-d6b668e0d1ae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.488752 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a209164b-2d48-42ff-9248-d6b668e0d1ae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.490121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a209164b-2d48-42ff-9248-d6b668e0d1ae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.491993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a209164b-2d48-42ff-9248-d6b668e0d1ae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.493864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a209164b-2d48-42ff-9248-d6b668e0d1ae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.494975 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a209164b-2d48-42ff-9248-d6b668e0d1ae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.637354 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f93df422-91a6-4ba2-8ba1-a61fbead4375 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.651015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f93df422-91a6-4ba2-8ba1-a61fbead4375 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.652971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f93df422-91a6-4ba2-8ba1-a61fbead4375 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.654594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f93df422-91a6-4ba2-8ba1-a61fbead4375 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 1.229401 Aug 24 08:56:40.668669 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 85/179] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:39 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:40.708258 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-13d059ec-ae01-4a79-ac9f-37f494992a74 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:40.709325 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-13d059ec-ae01-4a79-ac9f-37f494992a74 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:40.727492 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13d059ec-ae01-4a79-ac9f-37f494992a74 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.728209 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13d059ec-ae01-4a79-ac9f-37f494992a74 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.728988 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13d059ec-ae01-4a79-ac9f-37f494992a74 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.730076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13d059ec-ae01-4a79-ac9f-37f494992a74 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.730700 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13d059ec-ae01-4a79-ac9f-37f494992a74 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.731468 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13d059ec-ae01-4a79-ac9f-37f494992a74 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.747357 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a209164b-2d48-42ff-9248-d6b668e0d1ae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.760856 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a209164b-2d48-42ff-9248-d6b668e0d1ae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.303552 Aug 24 08:56:40.761784 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 95/180] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:40 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:40.944523 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-13d059ec-ae01-4a79-ac9f-37f494992a74 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.956902 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-13d059ec-ae01-4a79-ac9f-37f494992a74 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.253206 Aug 24 08:56:40.957820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 86/181] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:40 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:41.047578 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7713852f-b799-44be-9da9-d13c5698ddd4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:41.049784 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7713852f-b799-44be-9da9-d13c5698ddd4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:41.065537 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7713852f-b799-44be-9da9-d13c5698ddd4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.066818 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7713852f-b799-44be-9da9-d13c5698ddd4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.067544 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7713852f-b799-44be-9da9-d13c5698ddd4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.068469 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7713852f-b799-44be-9da9-d13c5698ddd4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.069505 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7713852f-b799-44be-9da9-d13c5698ddd4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.070359 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7713852f-b799-44be-9da9-d13c5698ddd4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.378990 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7713852f-b799-44be-9da9-d13c5698ddd4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:41.397420 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7713852f-b799-44be-9da9-d13c5698ddd4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.357716 Aug 24 08:56:41.401370 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 96/182] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:41 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:41.430910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-29550904-b5d5-44e8-bc1e-ed37aa37af48 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:41.432040 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-29550904-b5d5-44e8-bc1e-ed37aa37af48 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:41.453920 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29550904-b5d5-44e8-bc1e-ed37aa37af48 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.453920 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29550904-b5d5-44e8-bc1e-ed37aa37af48 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.453920 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29550904-b5d5-44e8-bc1e-ed37aa37af48 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.453920 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29550904-b5d5-44e8-bc1e-ed37aa37af48 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.454797 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29550904-b5d5-44e8-bc1e-ed37aa37af48 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.454797 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-29550904-b5d5-44e8-bc1e-ed37aa37af48 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.683929 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-867a4eb7-8975-4cb7-92fb-b910e2055e47 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:41.685274 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-867a4eb7-8975-4cb7-92fb-b910e2055e47 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:41.699832 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-867a4eb7-8975-4cb7-92fb-b910e2055e47 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.701193 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-867a4eb7-8975-4cb7-92fb-b910e2055e47 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.702043 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-867a4eb7-8975-4cb7-92fb-b910e2055e47 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.703931 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-867a4eb7-8975-4cb7-92fb-b910e2055e47 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.705132 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-867a4eb7-8975-4cb7-92fb-b910e2055e47 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.706988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-867a4eb7-8975-4cb7-92fb-b910e2055e47 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.777478 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-29550904-b5d5-44e8-bc1e-ed37aa37af48 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:41.793316 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-29550904-b5d5-44e8-bc1e-ed37aa37af48 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.366429 Aug 24 08:56:41.794274 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 87/183] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:41 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:41.806524 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-dcde8430-fd60-4f0a-80f0-b1e9ced16eb7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:41.807599 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-dcde8430-fd60-4f0a-80f0-b1e9ced16eb7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:41.819625 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dcde8430-fd60-4f0a-80f0-b1e9ced16eb7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.820734 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dcde8430-fd60-4f0a-80f0-b1e9ced16eb7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.821422 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dcde8430-fd60-4f0a-80f0-b1e9ced16eb7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.822357 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dcde8430-fd60-4f0a-80f0-b1e9ced16eb7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.823093 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dcde8430-fd60-4f0a-80f0-b1e9ced16eb7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.823797 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dcde8430-fd60-4f0a-80f0-b1e9ced16eb7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.060795 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-867a4eb7-8975-4cb7-92fb-b910e2055e47 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:42.070419 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-867a4eb7-8975-4cb7-92fb-b910e2055e47 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:42.072456 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-867a4eb7-8975-4cb7-92fb-b910e2055e47 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:42.076212 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-867a4eb7-8975-4cb7-92fb-b910e2055e47 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.400188 Aug 24 08:56:42.082210 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 97/184] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:41 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:42.087382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e011816d-7ea4-4627-b820-a95401e4deaf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:42.088093 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e011816d-7ea4-4627-b820-a95401e4deaf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:42.122804 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e011816d-7ea4-4627-b820-a95401e4deaf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.123308 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e011816d-7ea4-4627-b820-a95401e4deaf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.123955 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e011816d-7ea4-4627-b820-a95401e4deaf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.124912 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e011816d-7ea4-4627-b820-a95401e4deaf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.125556 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e011816d-7ea4-4627-b820-a95401e4deaf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.126139 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e011816d-7ea4-4627-b820-a95401e4deaf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.136096 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-dcde8430-fd60-4f0a-80f0-b1e9ced16eb7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:42.153683 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-dcde8430-fd60-4f0a-80f0-b1e9ced16eb7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.352344 Aug 24 08:56:42.159755 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:42.174113 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 88/185] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:41 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:42.191696 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-e04f97ae-1ed2-4527-9670-5735db267d4b req-d17af5bb-b2c4-4aec-9fac-1ee7fbe0f154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635351cd-1139-4659-9d13-086372a9af7c", "name": "network-vif-plugged", "status": "completed", "tag": "4ab0306a-2019-48d9-9e7f-8476d77391d3"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:42.234705 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e04f97ae-1ed2-4527-9670-5735db267d4b req-d17af5bb-b2c4-4aec-9fac-1ee7fbe0f154 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.235530 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e04f97ae-1ed2-4527-9670-5735db267d4b req-d17af5bb-b2c4-4aec-9fac-1ee7fbe0f154 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.236278 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e04f97ae-1ed2-4527-9670-5735db267d4b req-d17af5bb-b2c4-4aec-9fac-1ee7fbe0f154 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.279808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-e04f97ae-1ed2-4527-9670-5735db267d4b req-d17af5bb-b2c4-4aec-9fac-1ee7fbe0f154 service nova] Creating event network-vif-plugged:4ab0306a-2019-48d9-9e7f-8476d77391d3 for instance 635351cd-1139-4659-9d13-086372a9af7c on hv-cinder-85221 Aug 24 08:56:42.299783 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-e04f97ae-1ed2-4527-9670-5735db267d4b req-d17af5bb-b2c4-4aec-9fac-1ee7fbe0f154 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123135 Aug 24 08:56:42.302163 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 89/186] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:42.344364 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e011816d-7ea4-4627-b820-a95401e4deaf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:42.352960 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e011816d-7ea4-4627-b820-a95401e4deaf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.269329 Aug 24 08:56:42.353567 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 98/187] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:42 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:42.450945 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ef7bed7d-3a37-4c49-943a-1ade64ece282 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:42.456299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ef7bed7d-3a37-4c49-943a-1ade64ece282 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:42.467079 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef7bed7d-3a37-4c49-943a-1ade64ece282 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.468907 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef7bed7d-3a37-4c49-943a-1ade64ece282 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.469635 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef7bed7d-3a37-4c49-943a-1ade64ece282 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.470669 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef7bed7d-3a37-4c49-943a-1ade64ece282 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.471459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef7bed7d-3a37-4c49-943a-1ade64ece282 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.472265 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef7bed7d-3a37-4c49-943a-1ade64ece282 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.660164 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ef7bed7d-3a37-4c49-943a-1ade64ece282 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:42.668685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ef7bed7d-3a37-4c49-943a-1ade64ece282 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.227678 Aug 24 08:56:42.669032 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 90/188] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:42 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:42.829067 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f3c0fe9b-f07e-4734-9192-f855fc538133 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:42.829675 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f3c0fe9b-f07e-4734-9192-f855fc538133 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:42.836321 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3c0fe9b-f07e-4734-9192-f855fc538133 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.836836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3c0fe9b-f07e-4734-9192-f855fc538133 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.837270 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3c0fe9b-f07e-4734-9192-f855fc538133 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.837991 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3c0fe9b-f07e-4734-9192-f855fc538133 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.838433 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3c0fe9b-f07e-4734-9192-f855fc538133 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.838866 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3c0fe9b-f07e-4734-9192-f855fc538133 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.017139 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f3c0fe9b-f07e-4734-9192-f855fc538133 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.032252 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f3c0fe9b-f07e-4734-9192-f855fc538133 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.207291 Aug 24 08:56:43.033788 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 99/189] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:42 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:43.123631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-95ad07d8-c8d0-40a6-879a-fa7b1e63713e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:43.123631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-95ad07d8-c8d0-40a6-879a-fa7b1e63713e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:43.126461 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-95ad07d8-c8d0-40a6-879a-fa7b1e63713e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.127384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-95ad07d8-c8d0-40a6-879a-fa7b1e63713e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.128196 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-95ad07d8-c8d0-40a6-879a-fa7b1e63713e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.130228 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-95ad07d8-c8d0-40a6-879a-fa7b1e63713e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.131097 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-95ad07d8-c8d0-40a6-879a-fa7b1e63713e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.132856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-95ad07d8-c8d0-40a6-879a-fa7b1e63713e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.206663 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d899f663-912e-4a0d-89b2-88c74c377bdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:43.208302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d899f663-912e-4a0d-89b2-88c74c377bdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:43.223377 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d899f663-912e-4a0d-89b2-88c74c377bdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.224275 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d899f663-912e-4a0d-89b2-88c74c377bdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.225104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d899f663-912e-4a0d-89b2-88c74c377bdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.229545 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d899f663-912e-4a0d-89b2-88c74c377bdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.230041 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d899f663-912e-4a0d-89b2-88c74c377bdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.231835 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d899f663-912e-4a0d-89b2-88c74c377bdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.465397 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-95ad07d8-c8d0-40a6-879a-fa7b1e63713e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.480889 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-95ad07d8-c8d0-40a6-879a-fa7b1e63713e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.491224 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-95ad07d8-c8d0-40a6-879a-fa7b1e63713e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.497249 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-95ad07d8-c8d0-40a6-879a-fa7b1e63713e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.387992 Aug 24 08:56:43.498457 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 91/190] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:43 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:43.508050 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d899f663-912e-4a0d-89b2-88c74c377bdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.522705 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d899f663-912e-4a0d-89b2-88c74c377bdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.328500 Aug 24 08:56:43.524202 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 100/191] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:43 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:43.528703 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-86dcf40f-f292-4bc6-a278-227db3a0b34c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:43.529753 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-86dcf40f-f292-4bc6-a278-227db3a0b34c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:43.541670 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-86dcf40f-f292-4bc6-a278-227db3a0b34c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.542633 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-86dcf40f-f292-4bc6-a278-227db3a0b34c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.543572 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-86dcf40f-f292-4bc6-a278-227db3a0b34c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.545086 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-86dcf40f-f292-4bc6-a278-227db3a0b34c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.545746 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-86dcf40f-f292-4bc6-a278-227db3a0b34c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.546365 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-86dcf40f-f292-4bc6-a278-227db3a0b34c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.695195 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d793db3a-94f3-4289-b31e-8dd107f82fa6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:43.696952 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d793db3a-94f3-4289-b31e-8dd107f82fa6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:43.704730 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-86dcf40f-f292-4bc6-a278-227db3a0b34c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.706418 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d793db3a-94f3-4289-b31e-8dd107f82fa6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.707638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d793db3a-94f3-4289-b31e-8dd107f82fa6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.708962 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d793db3a-94f3-4289-b31e-8dd107f82fa6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.708962 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d793db3a-94f3-4289-b31e-8dd107f82fa6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.709523 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d793db3a-94f3-4289-b31e-8dd107f82fa6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.710013 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d793db3a-94f3-4289-b31e-8dd107f82fa6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.728795 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-86dcf40f-f292-4bc6-a278-227db3a0b34c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.228482 Aug 24 08:56:43.732686 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 92/192] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:43 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:43.911685 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d793db3a-94f3-4289-b31e-8dd107f82fa6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.922856 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d793db3a-94f3-4289-b31e-8dd107f82fa6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.235261 Aug 24 08:56:43.925268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 101/193] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:43 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:44.071927 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ef153cf2-41e5-4e3e-8f85-5ccd5e905045 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:44.073820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ef153cf2-41e5-4e3e-8f85-5ccd5e905045 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:44.085685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef153cf2-41e5-4e3e-8f85-5ccd5e905045 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.086859 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef153cf2-41e5-4e3e-8f85-5ccd5e905045 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.087867 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef153cf2-41e5-4e3e-8f85-5ccd5e905045 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.088981 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef153cf2-41e5-4e3e-8f85-5ccd5e905045 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.089749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef153cf2-41e5-4e3e-8f85-5ccd5e905045 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.090671 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef153cf2-41e5-4e3e-8f85-5ccd5e905045 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.368337 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ef153cf2-41e5-4e3e-8f85-5ccd5e905045 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:44.393301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ef153cf2-41e5-4e3e-8f85-5ccd5e905045 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1314 microversion: 2.1 time: 0.322979 Aug 24 08:56:44.393301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 93/194] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:44 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:44.547815 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e73f2f92-08aa-49fc-8c59-3fc9f57569ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:44.549059 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e73f2f92-08aa-49fc-8c59-3fc9f57569ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:44.559064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e73f2f92-08aa-49fc-8c59-3fc9f57569ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.559900 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e73f2f92-08aa-49fc-8c59-3fc9f57569ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.560701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e73f2f92-08aa-49fc-8c59-3fc9f57569ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.561084 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-14a6cf64-a5aa-4f39-aeee-a7943b0fbd78 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:44.561936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e73f2f92-08aa-49fc-8c59-3fc9f57569ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.562773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e73f2f92-08aa-49fc-8c59-3fc9f57569ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.563224 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-14a6cf64-a5aa-4f39-aeee-a7943b0fbd78 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:44.563516 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e73f2f92-08aa-49fc-8c59-3fc9f57569ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.576281 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-14a6cf64-a5aa-4f39-aeee-a7943b0fbd78 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.577125 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-14a6cf64-a5aa-4f39-aeee-a7943b0fbd78 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.577912 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-14a6cf64-a5aa-4f39-aeee-a7943b0fbd78 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.579109 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-14a6cf64-a5aa-4f39-aeee-a7943b0fbd78 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.579908 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-14a6cf64-a5aa-4f39-aeee-a7943b0fbd78 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.580701 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-14a6cf64-a5aa-4f39-aeee-a7943b0fbd78 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.809997 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e73f2f92-08aa-49fc-8c59-3fc9f57569ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:44.826408 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e73f2f92-08aa-49fc-8c59-3fc9f57569ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:44.848739 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e73f2f92-08aa-49fc-8c59-3fc9f57569ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:44.848739 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e73f2f92-08aa-49fc-8c59-3fc9f57569ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.298118 Aug 24 08:56:44.848739 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 102/195] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:44 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:44.853609 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0dbbee3b-0d01-4bf5-a492-fe2a92db1edc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:44.854444 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0dbbee3b-0d01-4bf5-a492-fe2a92db1edc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:44.864067 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0dbbee3b-0d01-4bf5-a492-fe2a92db1edc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.865336 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0dbbee3b-0d01-4bf5-a492-fe2a92db1edc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.876381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0dbbee3b-0d01-4bf5-a492-fe2a92db1edc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.876381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0dbbee3b-0d01-4bf5-a492-fe2a92db1edc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.876381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0dbbee3b-0d01-4bf5-a492-fe2a92db1edc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.876381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0dbbee3b-0d01-4bf5-a492-fe2a92db1edc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.969480 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-14a6cf64-a5aa-4f39-aeee-a7943b0fbd78 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:44.980337 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-14a6cf64-a5aa-4f39-aeee-a7943b0fbd78 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.428273 Aug 24 08:56:44.980643 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 94/196] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:44 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:45.005555 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6cb714a4-afe2-496e-91c0-c8a87e6905d5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:45.006910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6cb714a4-afe2-496e-91c0-c8a87e6905d5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:45.020426 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6cb714a4-afe2-496e-91c0-c8a87e6905d5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:45.021293 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6cb714a4-afe2-496e-91c0-c8a87e6905d5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:45.022518 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6cb714a4-afe2-496e-91c0-c8a87e6905d5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:45.032566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6cb714a4-afe2-496e-91c0-c8a87e6905d5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:45.034758 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6cb714a4-afe2-496e-91c0-c8a87e6905d5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:45.036054 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6cb714a4-afe2-496e-91c0-c8a87e6905d5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:45.117980 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0dbbee3b-0d01-4bf5-a492-fe2a92db1edc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:45.132824 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0dbbee3b-0d01-4bf5-a492-fe2a92db1edc tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.286701 Aug 24 08:56:45.133526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 103/197] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:44 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:45.277514 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6cb714a4-afe2-496e-91c0-c8a87e6905d5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:45.286410 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6cb714a4-afe2-496e-91c0-c8a87e6905d5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.304431 Aug 24 08:56:45.286900 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 95/198] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:44 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:45.416588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1d76b7cb-0f7f-4d15-a3a8-9b2b68a506b0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:45.417186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1d76b7cb-0f7f-4d15-a3a8-9b2b68a506b0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:45.423911 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d76b7cb-0f7f-4d15-a3a8-9b2b68a506b0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:45.424407 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d76b7cb-0f7f-4d15-a3a8-9b2b68a506b0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:45.424880 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d76b7cb-0f7f-4d15-a3a8-9b2b68a506b0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:45.425595 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d76b7cb-0f7f-4d15-a3a8-9b2b68a506b0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:45.426726 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d76b7cb-0f7f-4d15-a3a8-9b2b68a506b0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:45.427186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d76b7cb-0f7f-4d15-a3a8-9b2b68a506b0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:45.666838 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1d76b7cb-0f7f-4d15-a3a8-9b2b68a506b0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:45.693126 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1d76b7cb-0f7f-4d15-a3a8-9b2b68a506b0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1501 microversion: 2.1 time: 0.277320 Aug 24 08:56:45.704171 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 104/199] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:45 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1501 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:45.872866 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5844db00-8fdf-4450-b42e-af516c92f958 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:45.873704 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5844db00-8fdf-4450-b42e-af516c92f958 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:45.884427 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5844db00-8fdf-4450-b42e-af516c92f958 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:45.889223 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5844db00-8fdf-4450-b42e-af516c92f958 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:45.889912 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5844db00-8fdf-4450-b42e-af516c92f958 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:45.890779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5844db00-8fdf-4450-b42e-af516c92f958 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:45.891394 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5844db00-8fdf-4450-b42e-af516c92f958 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:45.891926 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5844db00-8fdf-4450-b42e-af516c92f958 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:46.008633 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f7326d31-7cc1-4df8-8a24-7636d79e4a97 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:46.009902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f7326d31-7cc1-4df8-8a24-7636d79e4a97 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:46.021703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f7326d31-7cc1-4df8-8a24-7636d79e4a97 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:46.022689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f7326d31-7cc1-4df8-8a24-7636d79e4a97 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:46.023532 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f7326d31-7cc1-4df8-8a24-7636d79e4a97 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:46.025216 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f7326d31-7cc1-4df8-8a24-7636d79e4a97 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:46.026714 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f7326d31-7cc1-4df8-8a24-7636d79e4a97 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:46.027923 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f7326d31-7cc1-4df8-8a24-7636d79e4a97 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:46.231002 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5844db00-8fdf-4450-b42e-af516c92f958 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:46.248389 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5844db00-8fdf-4450-b42e-af516c92f958 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:46.251623 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5844db00-8fdf-4450-b42e-af516c92f958 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:46.253850 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5844db00-8fdf-4450-b42e-af516c92f958 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.385226 Aug 24 08:56:46.255675 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 96/200] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:45 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:46.274248 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d494cb04-54bc-43ec-bc0c-9e5d7ca91aa6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:46.275961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d494cb04-54bc-43ec-bc0c-9e5d7ca91aa6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:46.287978 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d494cb04-54bc-43ec-bc0c-9e5d7ca91aa6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:46.290085 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d494cb04-54bc-43ec-bc0c-9e5d7ca91aa6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:46.291683 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d494cb04-54bc-43ec-bc0c-9e5d7ca91aa6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:46.293180 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d494cb04-54bc-43ec-bc0c-9e5d7ca91aa6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:46.294222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d494cb04-54bc-43ec-bc0c-9e5d7ca91aa6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:46.295388 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d494cb04-54bc-43ec-bc0c-9e5d7ca91aa6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:46.345626 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f7326d31-7cc1-4df8-8a24-7636d79e4a97 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:46.362573 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f7326d31-7cc1-4df8-8a24-7636d79e4a97 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.362281 Aug 24 08:56:46.364341 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 105/201] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:45 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:46.373578 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-85c61717-78c5-46f2-99ff-99da874ca7d6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:46.375100 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-85c61717-78c5-46f2-99ff-99da874ca7d6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:46.389815 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-85c61717-78c5-46f2-99ff-99da874ca7d6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:46.391139 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-85c61717-78c5-46f2-99ff-99da874ca7d6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:46.392158 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-85c61717-78c5-46f2-99ff-99da874ca7d6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:46.393771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-85c61717-78c5-46f2-99ff-99da874ca7d6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:46.395445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-85c61717-78c5-46f2-99ff-99da874ca7d6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:46.396441 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-85c61717-78c5-46f2-99ff-99da874ca7d6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:46.557102 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d494cb04-54bc-43ec-bc0c-9e5d7ca91aa6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:46.570092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d494cb04-54bc-43ec-bc0c-9e5d7ca91aa6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.311442 Aug 24 08:56:46.571031 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 97/202] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:46 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:46.759877 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-85c61717-78c5-46f2-99ff-99da874ca7d6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:46.778681 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-85c61717-78c5-46f2-99ff-99da874ca7d6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.412209 Aug 24 08:56:46.786732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 106/203] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:46 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:47.283365 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c968c61c-0750-471b-a2ad-054dfc4450a3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:47.284210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c968c61c-0750-471b-a2ad-054dfc4450a3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:47.292803 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c968c61c-0750-471b-a2ad-054dfc4450a3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.293264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c968c61c-0750-471b-a2ad-054dfc4450a3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.293819 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c968c61c-0750-471b-a2ad-054dfc4450a3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.294884 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c968c61c-0750-471b-a2ad-054dfc4450a3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.295493 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c968c61c-0750-471b-a2ad-054dfc4450a3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.296169 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c968c61c-0750-471b-a2ad-054dfc4450a3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.412653 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-13db559d-afc2-4ba6-9473-673039e23a52 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:47.416959 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-13db559d-afc2-4ba6-9473-673039e23a52 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:47.428342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-13db559d-afc2-4ba6-9473-673039e23a52 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.430013 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-13db559d-afc2-4ba6-9473-673039e23a52 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.431363 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-13db559d-afc2-4ba6-9473-673039e23a52 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.432848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-13db559d-afc2-4ba6-9473-673039e23a52 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.433869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-13db559d-afc2-4ba6-9473-673039e23a52 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.434842 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-13db559d-afc2-4ba6-9473-673039e23a52 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.543936 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c968c61c-0750-471b-a2ad-054dfc4450a3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:47.580365 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c968c61c-0750-471b-a2ad-054dfc4450a3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:47.590407 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c968c61c-0750-471b-a2ad-054dfc4450a3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:47.592928 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c968c61c-0750-471b-a2ad-054dfc4450a3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.315982 Aug 24 08:56:47.597277 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 98/204] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:47 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:47.613157 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e85d698b-faf2-47cc-83a8-df4be4699202 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:47.620477 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e85d698b-faf2-47cc-83a8-df4be4699202 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:47.659127 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e85d698b-faf2-47cc-83a8-df4be4699202 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.659127 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e85d698b-faf2-47cc-83a8-df4be4699202 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.659638 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e85d698b-faf2-47cc-83a8-df4be4699202 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.662117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e85d698b-faf2-47cc-83a8-df4be4699202 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.664225 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e85d698b-faf2-47cc-83a8-df4be4699202 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.667701 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e85d698b-faf2-47cc-83a8-df4be4699202 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.671363 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-13db559d-afc2-4ba6-9473-673039e23a52 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:47.683590 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-13db559d-afc2-4ba6-9473-673039e23a52 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.278858 Aug 24 08:56:47.687241 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 107/205] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:47 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:47.800940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ad5b8fa8-f94d-4fe5-bc01-c2535852a600 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:47.802946 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ad5b8fa8-f94d-4fe5-bc01-c2535852a600 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:47.810644 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ad5b8fa8-f94d-4fe5-bc01-c2535852a600 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.811413 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ad5b8fa8-f94d-4fe5-bc01-c2535852a600 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.812009 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ad5b8fa8-f94d-4fe5-bc01-c2535852a600 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.813175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ad5b8fa8-f94d-4fe5-bc01-c2535852a600 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.813856 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ad5b8fa8-f94d-4fe5-bc01-c2535852a600 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.814433 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ad5b8fa8-f94d-4fe5-bc01-c2535852a600 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:48.085774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ad5b8fa8-f94d-4fe5-bc01-c2535852a600 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:48.099245 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ad5b8fa8-f94d-4fe5-bc01-c2535852a600 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.302505 Aug 24 08:56:48.100575 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 108/206] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:47 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:48.106197 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e85d698b-faf2-47cc-83a8-df4be4699202 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:48.123028 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e85d698b-faf2-47cc-83a8-df4be4699202 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.517112 Aug 24 08:56:48.125408 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 99/207] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:47 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:48.349710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-023ba135-826f-4149-bbd6-ff032d6f8d3d req-ff2c37ea-f29f-40a9-9786-90d3981e6793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abdb5828-315b-4046-9985-95e58a2f24b3", "name": "network-vif-plugged", "status": "completed", "tag": "756cdfb7-826d-4039-9977-c15d62078dd5"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:48.389311 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-023ba135-826f-4149-bbd6-ff032d6f8d3d req-ff2c37ea-f29f-40a9-9786-90d3981e6793 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:48.390045 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-023ba135-826f-4149-bbd6-ff032d6f8d3d req-ff2c37ea-f29f-40a9-9786-90d3981e6793 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:48.390662 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-023ba135-826f-4149-bbd6-ff032d6f8d3d req-ff2c37ea-f29f-40a9-9786-90d3981e6793 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:48.417578 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-023ba135-826f-4149-bbd6-ff032d6f8d3d req-ff2c37ea-f29f-40a9-9786-90d3981e6793 service nova] Creating event network-vif-plugged:756cdfb7-826d-4039-9977-c15d62078dd5 for instance abdb5828-315b-4046-9985-95e58a2f24b3 on hv-cinder-85221 Aug 24 08:56:48.425385 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-023ba135-826f-4149-bbd6-ff032d6f8d3d req-ff2c37ea-f29f-40a9-9786-90d3981e6793 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083396 Aug 24 08:56:48.427004 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 109/208] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:48.636270 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e0c3c782-5e6c-4867-bf41-51bdf0462416 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:48.640491 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e0c3c782-5e6c-4867-bf41-51bdf0462416 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:48.661066 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e0c3c782-5e6c-4867-bf41-51bdf0462416 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:48.661066 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e0c3c782-5e6c-4867-bf41-51bdf0462416 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:48.661066 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e0c3c782-5e6c-4867-bf41-51bdf0462416 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:48.662434 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e0c3c782-5e6c-4867-bf41-51bdf0462416 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:48.663671 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e0c3c782-5e6c-4867-bf41-51bdf0462416 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:48.664999 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e0c3c782-5e6c-4867-bf41-51bdf0462416 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:48.710154 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9155a751-4d4e-4d53-9201-7d8705b9c957 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:48.713400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:48.713565 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9155a751-4d4e-4d53-9201-7d8705b9c957 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:48.733027 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9155a751-4d4e-4d53-9201-7d8705b9c957 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:48.733690 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9155a751-4d4e-4d53-9201-7d8705b9c957 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:48.734178 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9155a751-4d4e-4d53-9201-7d8705b9c957 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:48.738326 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9155a751-4d4e-4d53-9201-7d8705b9c957 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:48.753087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9155a751-4d4e-4d53-9201-7d8705b9c957 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:48.753087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9155a751-4d4e-4d53-9201-7d8705b9c957 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:48.936292 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9155a751-4d4e-4d53-9201-7d8705b9c957 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:48.946526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9155a751-4d4e-4d53-9201-7d8705b9c957 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.241913 Aug 24 08:56:48.947392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 110/209] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:48 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:49.014117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e0c3c782-5e6c-4867-bf41-51bdf0462416 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:49.038008 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e0c3c782-5e6c-4867-bf41-51bdf0462416 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:49.041685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e0c3c782-5e6c-4867-bf41-51bdf0462416 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:49.045600 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e0c3c782-5e6c-4867-bf41-51bdf0462416 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.416455 Aug 24 08:56:49.048225 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 100/210] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:48 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:49.136993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-dc8af29e-576d-4391-b7b2-22b49368e210 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:49.137854 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-dc8af29e-576d-4391-b7b2-22b49368e210 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:49.152705 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b857932c-79d5-4158-9504-ec6b5478fa7f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:49.153651 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b857932c-79d5-4158-9504-ec6b5478fa7f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:49.162336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b857932c-79d5-4158-9504-ec6b5478fa7f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.163123 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dc8af29e-576d-4391-b7b2-22b49368e210 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.163793 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dc8af29e-576d-4391-b7b2-22b49368e210 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.164643 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dc8af29e-576d-4391-b7b2-22b49368e210 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.165020 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b857932c-79d5-4158-9504-ec6b5478fa7f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.165569 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b857932c-79d5-4158-9504-ec6b5478fa7f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.166460 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dc8af29e-576d-4391-b7b2-22b49368e210 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.167288 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b857932c-79d5-4158-9504-ec6b5478fa7f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.167858 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dc8af29e-576d-4391-b7b2-22b49368e210 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.168384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b857932c-79d5-4158-9504-ec6b5478fa7f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.168913 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dc8af29e-576d-4391-b7b2-22b49368e210 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.171209 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b857932c-79d5-4158-9504-ec6b5478fa7f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.383553 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-dc8af29e-576d-4391-b7b2-22b49368e210 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:49.414859 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-dc8af29e-576d-4391-b7b2-22b49368e210 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.280719 Aug 24 08:56:49.432724 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 111/211] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:49 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:49.439134 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9e78074f-5f5b-49e1-8426-01da87cc5cbe tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "628bb3b1-aec2-4c38-8f82-83d04de7dac4"}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:49.442886 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9e78074f-5f5b-49e1-8426-01da87cc5cbe tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:49.450813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e78074f-5f5b-49e1-8426-01da87cc5cbe tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.451575 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e78074f-5f5b-49e1-8426-01da87cc5cbe tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.452263 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e78074f-5f5b-49e1-8426-01da87cc5cbe tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.453175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e78074f-5f5b-49e1-8426-01da87cc5cbe tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.453920 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e78074f-5f5b-49e1-8426-01da87cc5cbe tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.454822 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e78074f-5f5b-49e1-8426-01da87cc5cbe tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.678532 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b857932c-79d5-4158-9504-ec6b5478fa7f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:49.686838 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b857932c-79d5-4158-9504-ec6b5478fa7f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.544274 Aug 24 08:56:49.687431 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 101/212] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:49 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:49.974019 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a59f8c7b-628f-4b71-a86d-411ca182cc8a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:49.985707 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a59f8c7b-628f-4b71-a86d-411ca182cc8a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:49.994157 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a59f8c7b-628f-4b71-a86d-411ca182cc8a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.995871 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a59f8c7b-628f-4b71-a86d-411ca182cc8a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.997059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a59f8c7b-628f-4b71-a86d-411ca182cc8a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:50.010757 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a59f8c7b-628f-4b71-a86d-411ca182cc8a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:50.012402 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a59f8c7b-628f-4b71-a86d-411ca182cc8a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:50.016094 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a59f8c7b-628f-4b71-a86d-411ca182cc8a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:50.572851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a59f8c7b-628f-4b71-a86d-411ca182cc8a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:50.582611 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a59f8c7b-628f-4b71-a86d-411ca182cc8a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.615252 Aug 24 08:56:50.582611 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 102/213] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:49 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:50.598326 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a111be0e-357a-4b30-a972-6f558ff7a3c1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:50.599185 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a111be0e-357a-4b30-a972-6f558ff7a3c1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:50.615461 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a111be0e-357a-4b30-a972-6f558ff7a3c1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:50.616215 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a111be0e-357a-4b30-a972-6f558ff7a3c1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:50.616884 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a111be0e-357a-4b30-a972-6f558ff7a3c1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:50.617805 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a111be0e-357a-4b30-a972-6f558ff7a3c1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:50.618519 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a111be0e-357a-4b30-a972-6f558ff7a3c1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:50.619147 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a111be0e-357a-4b30-a972-6f558ff7a3c1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:50.904799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a111be0e-357a-4b30-a972-6f558ff7a3c1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:50.931072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a111be0e-357a-4b30-a972-6f558ff7a3c1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:50.934364 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a111be0e-357a-4b30-a972-6f558ff7a3c1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:50.936333 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a111be0e-357a-4b30-a972-6f558ff7a3c1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.347465 Aug 24 08:56:50.937420 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 103/214] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:50 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:50.943781 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-64848c9c-dfb3-490a-824d-f4baacfc1b81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:50.944702 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-64848c9c-dfb3-490a-824d-f4baacfc1b81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:50.951322 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-64848c9c-dfb3-490a-824d-f4baacfc1b81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:50.951805 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-64848c9c-dfb3-490a-824d-f4baacfc1b81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:50.952234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-64848c9c-dfb3-490a-824d-f4baacfc1b81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:50.952982 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-64848c9c-dfb3-490a-824d-f4baacfc1b81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:50.953429 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-64848c9c-dfb3-490a-824d-f4baacfc1b81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:50.953846 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-64848c9c-dfb3-490a-824d-f4baacfc1b81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.128064 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-64848c9c-dfb3-490a-824d-f4baacfc1b81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:51.136787 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-64848c9c-dfb3-490a-824d-f4baacfc1b81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.197780 Aug 24 08:56:51.137369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 104/215] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:50 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:51.153615 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-63e1ee08-541d-479b-9ce7-3f343106b708 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:51.154490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-63e1ee08-541d-479b-9ce7-3f343106b708 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:51.162411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-63e1ee08-541d-479b-9ce7-3f343106b708 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.162970 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-63e1ee08-541d-479b-9ce7-3f343106b708 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.163422 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-63e1ee08-541d-479b-9ce7-3f343106b708 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.164117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-63e1ee08-541d-479b-9ce7-3f343106b708 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.164640 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-63e1ee08-541d-479b-9ce7-3f343106b708 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.165713 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-63e1ee08-541d-479b-9ce7-3f343106b708 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.250146 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9e78074f-5f5b-49e1-8426-01da87cc5cbe tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "POST /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.815829 Aug 24 08:56:51.250835 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 112/216] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 08:56:49 2022] POST /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3/os-volume_attachments => generated 194 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:51.256517 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-370942f6-ce93-4153-b482-70dc010878e4 req-c8e42ada-9eea-4600-b3f8-71d308cb6da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91522d87-2654-4cee-9b8c-b7431ed55dd3", "name": "network-vif-plugged", "status": "completed", "tag": "4a80d617-a0d7-4cc6-b5b2-6590c4bdea44"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:51.266942 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-370942f6-ce93-4153-b482-70dc010878e4 req-c8e42ada-9eea-4600-b3f8-71d308cb6da8 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.267414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-370942f6-ce93-4153-b482-70dc010878e4 req-c8e42ada-9eea-4600-b3f8-71d308cb6da8 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.267842 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-370942f6-ce93-4153-b482-70dc010878e4 req-c8e42ada-9eea-4600-b3f8-71d308cb6da8 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.289625 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-370942f6-ce93-4153-b482-70dc010878e4 req-c8e42ada-9eea-4600-b3f8-71d308cb6da8 service nova] Creating event network-vif-plugged:4a80d617-a0d7-4cc6-b5b2-6590c4bdea44 for instance 91522d87-2654-4cee-9b8c-b7431ed55dd3 on hv-cinder-85221 Aug 24 08:56:51.303534 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-370942f6-ce93-4153-b482-70dc010878e4 req-c8e42ada-9eea-4600-b3f8-71d308cb6da8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051252 Aug 24 08:56:51.304146 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 113/217] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:51.328444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-63e1ee08-541d-479b-9ce7-3f343106b708 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:51.343959 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-63e1ee08-541d-479b-9ce7-3f343106b708 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.205051 Aug 24 08:56:51.357678 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 105/218] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:51 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:51.620728 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3d6959eb-b3e9-41f0-971c-c2de7720f4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:51.621792 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3d6959eb-b3e9-41f0-971c-c2de7720f4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:51.630856 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d6959eb-b3e9-41f0-971c-c2de7720f4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.631574 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d6959eb-b3e9-41f0-971c-c2de7720f4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.631993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d6959eb-b3e9-41f0-971c-c2de7720f4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.632758 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d6959eb-b3e9-41f0-971c-c2de7720f4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.633218 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d6959eb-b3e9-41f0-971c-c2de7720f4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.633640 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d6959eb-b3e9-41f0-971c-c2de7720f4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.833979 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3d6959eb-b3e9-41f0-971c-c2de7720f4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:51.849834 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3d6959eb-b3e9-41f0-971c-c2de7720f4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.235201 Aug 24 08:56:51.861450 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 114/219] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:51 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:51.963051 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-146402a4-0fe9-44d8-92a0-61294d4be94d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:51.965057 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-146402a4-0fe9-44d8-92a0-61294d4be94d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:51.975830 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-146402a4-0fe9-44d8-92a0-61294d4be94d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.976660 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-146402a4-0fe9-44d8-92a0-61294d4be94d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.977363 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-146402a4-0fe9-44d8-92a0-61294d4be94d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.978580 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-146402a4-0fe9-44d8-92a0-61294d4be94d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.979361 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-146402a4-0fe9-44d8-92a0-61294d4be94d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.980108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-146402a4-0fe9-44d8-92a0-61294d4be94d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:52.162570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-96ef074c-e3f5-4370-9c06-55ca91da553c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:52.163660 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-96ef074c-e3f5-4370-9c06-55ca91da553c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:52.172762 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96ef074c-e3f5-4370-9c06-55ca91da553c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.173489 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96ef074c-e3f5-4370-9c06-55ca91da553c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.180253 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96ef074c-e3f5-4370-9c06-55ca91da553c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:52.180253 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96ef074c-e3f5-4370-9c06-55ca91da553c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.180253 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96ef074c-e3f5-4370-9c06-55ca91da553c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.180253 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96ef074c-e3f5-4370-9c06-55ca91da553c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:52.182142 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:52.299760 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-146402a4-0fe9-44d8-92a0-61294d4be94d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:52.323722 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-146402a4-0fe9-44d8-92a0-61294d4be94d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:52.327821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-146402a4-0fe9-44d8-92a0-61294d4be94d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:52.331060 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-146402a4-0fe9-44d8-92a0-61294d4be94d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1406 microversion: 2.20 time: 0.372838 Aug 24 08:56:52.332581 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 106/220] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:51 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1406 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:52.377180 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4dfedad6-17b6-427e-9b84-39bf0234ef8c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:52.380566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4dfedad6-17b6-427e-9b84-39bf0234ef8c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:52.395087 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dfedad6-17b6-427e-9b84-39bf0234ef8c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.396308 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dfedad6-17b6-427e-9b84-39bf0234ef8c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.398498 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dfedad6-17b6-427e-9b84-39bf0234ef8c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:52.400654 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dfedad6-17b6-427e-9b84-39bf0234ef8c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.411640 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dfedad6-17b6-427e-9b84-39bf0234ef8c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.413319 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dfedad6-17b6-427e-9b84-39bf0234ef8c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:52.589582 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-96ef074c-e3f5-4370-9c06-55ca91da553c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:52.602782 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-96ef074c-e3f5-4370-9c06-55ca91da553c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1367 microversion: 2.1 time: 0.445685 Aug 24 08:56:52.603571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 115/221] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:52 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1367 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:52.874462 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5ab2768f-c6cf-4175-9904-f2327f8ae373 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:52.875076 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5ab2768f-c6cf-4175-9904-f2327f8ae373 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:52.883097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5ab2768f-c6cf-4175-9904-f2327f8ae373 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.883794 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5ab2768f-c6cf-4175-9904-f2327f8ae373 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.884205 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5ab2768f-c6cf-4175-9904-f2327f8ae373 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:52.884892 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5ab2768f-c6cf-4175-9904-f2327f8ae373 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.885550 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5ab2768f-c6cf-4175-9904-f2327f8ae373 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.885967 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5ab2768f-c6cf-4175-9904-f2327f8ae373 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.060746 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4dfedad6-17b6-427e-9b84-39bf0234ef8c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:53.073543 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4dfedad6-17b6-427e-9b84-39bf0234ef8c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.707890 Aug 24 08:56:53.074154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 107/222] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:52 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:53.101860 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5ab2768f-c6cf-4175-9904-f2327f8ae373 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:53.115654 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5ab2768f-c6cf-4175-9904-f2327f8ae373 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.245167 Aug 24 08:56:53.116251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 116/223] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:52 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:53.330482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-912d6517-23a1-4b12-8f49-510089aabede req-79706c23-4d45-4dfa-b3a9-60d594ce80f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a46236b-ed03-4f8e-8eba-3d04a06056a1", "name": "network-vif-plugged", "status": "completed", "tag": "53dc34cd-6619-41da-8d76-3a1724dbcce6"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:53.356903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-450ac194-0026-4185-b62c-cbb5134a31a2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:53.357898 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-450ac194-0026-4185-b62c-cbb5134a31a2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:53.364825 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-912d6517-23a1-4b12-8f49-510089aabede req-79706c23-4d45-4dfa-b3a9-60d594ce80f1 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.367856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-912d6517-23a1-4b12-8f49-510089aabede req-79706c23-4d45-4dfa-b3a9-60d594ce80f1 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.370593 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-912d6517-23a1-4b12-8f49-510089aabede req-79706c23-4d45-4dfa-b3a9-60d594ce80f1 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.371961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-450ac194-0026-4185-b62c-cbb5134a31a2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.373863 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-450ac194-0026-4185-b62c-cbb5134a31a2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.374565 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-450ac194-0026-4185-b62c-cbb5134a31a2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.376393 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-450ac194-0026-4185-b62c-cbb5134a31a2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.377177 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-450ac194-0026-4185-b62c-cbb5134a31a2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.378463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-450ac194-0026-4185-b62c-cbb5134a31a2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.409107 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-912d6517-23a1-4b12-8f49-510089aabede req-79706c23-4d45-4dfa-b3a9-60d594ce80f1 service nova] Creating event network-vif-plugged:53dc34cd-6619-41da-8d76-3a1724dbcce6 for instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 on hv-cinder-85221 Aug 24 08:56:53.418985 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-912d6517-23a1-4b12-8f49-510089aabede req-79706c23-4d45-4dfa-b3a9-60d594ce80f1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090438 Aug 24 08:56:53.420625 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 108/224] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:53.629482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3c6f7795-14e2-4f9f-b5d2-ed6a9bd9591f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:53.629482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3c6f7795-14e2-4f9f-b5d2-ed6a9bd9591f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:53.643064 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3c6f7795-14e2-4f9f-b5d2-ed6a9bd9591f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.644458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3c6f7795-14e2-4f9f-b5d2-ed6a9bd9591f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.645144 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3c6f7795-14e2-4f9f-b5d2-ed6a9bd9591f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.653090 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3c6f7795-14e2-4f9f-b5d2-ed6a9bd9591f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.658605 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3c6f7795-14e2-4f9f-b5d2-ed6a9bd9591f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.659255 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3c6f7795-14e2-4f9f-b5d2-ed6a9bd9591f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.681931 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-450ac194-0026-4185-b62c-cbb5134a31a2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:53.698429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-450ac194-0026-4185-b62c-cbb5134a31a2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:53.701955 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-450ac194-0026-4185-b62c-cbb5134a31a2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:53.704506 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-450ac194-0026-4185-b62c-cbb5134a31a2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1598 microversion: 2.20 time: 0.351746 Aug 24 08:56:53.706065 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 117/225] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:53 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1598 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:53.747839 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2abe24fc-cbac-4826-bfa7-2037a900801b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:53.749733 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2abe24fc-cbac-4826-bfa7-2037a900801b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:53.765722 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2abe24fc-cbac-4826-bfa7-2037a900801b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.767378 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2abe24fc-cbac-4826-bfa7-2037a900801b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.768296 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2abe24fc-cbac-4826-bfa7-2037a900801b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.769822 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2abe24fc-cbac-4826-bfa7-2037a900801b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.771122 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2abe24fc-cbac-4826-bfa7-2037a900801b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.772186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2abe24fc-cbac-4826-bfa7-2037a900801b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.896103 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3c6f7795-14e2-4f9f-b5d2-ed6a9bd9591f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:53.909293 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3c6f7795-14e2-4f9f-b5d2-ed6a9bd9591f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1557 microversion: 2.1 time: 0.286997 Aug 24 08:56:53.910597 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 109/226] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:53 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1557 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:53.942980 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9be36a43-9ff9-40d3-a71a-5e4e59f69bc1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:53.944169 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9be36a43-9ff9-40d3-a71a-5e4e59f69bc1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:53.953333 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9be36a43-9ff9-40d3-a71a-5e4e59f69bc1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.953833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9be36a43-9ff9-40d3-a71a-5e4e59f69bc1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.954722 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9be36a43-9ff9-40d3-a71a-5e4e59f69bc1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.954889 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2abe24fc-cbac-4826-bfa7-2037a900801b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.212748 Aug 24 08:56:53.955471 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9be36a43-9ff9-40d3-a71a-5e4e59f69bc1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.955932 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9be36a43-9ff9-40d3-a71a-5e4e59f69bc1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.956609 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 118/227] 10.222.0.55 () {60 vars in 1316 bytes} [Wed Aug 24 08:56:53 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 08:56:53.964470 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9be36a43-9ff9-40d3-a71a-5e4e59f69bc1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:54.077038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-604704845", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "networks": [{"uuid": "eb54e597-68c7-4db7-beca-c672bbf2ac24"}]}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:54.174555 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.network.neutron [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] validate_networks() for [('eb54e597-68c7-4db7-beca-c672bbf2ac24', None, None, None, None, None)] {{(pid=132984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:56:54.232254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9be36a43-9ff9-40d3-a71a-5e4e59f69bc1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.294809 Aug 24 08:56:54.234096 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 110/228] 10.222.0.55 () {58 vars in 1275 bytes} [Wed Aug 24 08:56:53 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/os-interface => generated 285 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:56:54.240064 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-84c9463d-a206-4950-b34b-b5a901933b1e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:54.241077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-84c9463d-a206-4950-b34b-b5a901933b1e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:54.258695 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-84c9463d-a206-4950-b34b-b5a901933b1e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:54.259646 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-84c9463d-a206-4950-b34b-b5a901933b1e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:54.260860 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-84c9463d-a206-4950-b34b-b5a901933b1e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:54.262835 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-84c9463d-a206-4950-b34b-b5a901933b1e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:54.264532 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-84c9463d-a206-4950-b34b-b5a901933b1e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:54.267185 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-84c9463d-a206-4950-b34b-b5a901933b1e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:54.722674 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Flavor limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:56:54.724335 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Image limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:56:54.725355 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Flavor pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:56:54.726399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Image pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:56:54.728079 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:56:54.745759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:54.746983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:54.747962 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:54.749925 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:54.751022 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:54.752217 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:54.812663 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Getting quotas for project f9753d09aeea45378d637bf28536bb7d. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:56:54.817936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:54.822346 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Getting quotas for user bb815fa9f45a4b1db1f30fbfaeb3c4c9 and project f9753d09aeea45378d637bf28536bb7d. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:56:54.852702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Going to run 1 instances... {{(pid=132984) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:56:54.852702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:56:55.189873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6fdff58e-f3fc-4e6c-ad02-37121a35c40f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.118064 Aug 24 08:56:55.197272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 119/229] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 08:56:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:56:55.202874 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1b8423f6-008e-4505-bede-dec4dc9b304e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:55.203746 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1b8423f6-008e-4505-bede-dec4dc9b304e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:55.212247 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1b8423f6-008e-4505-bede-dec4dc9b304e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:55.213090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1b8423f6-008e-4505-bede-dec4dc9b304e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:55.213734 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1b8423f6-008e-4505-bede-dec4dc9b304e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:55.214746 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1b8423f6-008e-4505-bede-dec4dc9b304e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:55.215424 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1b8423f6-008e-4505-bede-dec4dc9b304e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:55.216007 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1b8423f6-008e-4505-bede-dec4dc9b304e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:55.561297 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1b8423f6-008e-4505-bede-dec4dc9b304e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:55.574043 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1b8423f6-008e-4505-bede-dec4dc9b304e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.375114 Aug 24 08:56:55.575650 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 120/230] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:55 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:55.604363 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0f46be3a-bd19-4d10-8f6f-5c6d33792a8f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:55.605069 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0f46be3a-bd19-4d10-8f6f-5c6d33792a8f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:55.738271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0f46be3a-bd19-4d10-8f6f-5c6d33792a8f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:55.747480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0f46be3a-bd19-4d10-8f6f-5c6d33792a8f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1213 microversion: 2.1 time: 0.156410 Aug 24 08:56:55.762161 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 121/231] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:55 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1213 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:55.816763 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-84c9463d-a206-4950-b34b-b5a901933b1e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:55.837525 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-84c9463d-a206-4950-b34b-b5a901933b1e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 1.602051 Aug 24 08:56:55.848107 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 111/232] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:54 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:56.601369 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-94fed135-4b5b-4860-a13b-3fcb67959915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:56.602647 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-94fed135-4b5b-4860-a13b-3fcb67959915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:56.614856 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-94fed135-4b5b-4860-a13b-3fcb67959915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:56.615960 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-94fed135-4b5b-4860-a13b-3fcb67959915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:56.616846 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-94fed135-4b5b-4860-a13b-3fcb67959915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:56.618119 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-94fed135-4b5b-4860-a13b-3fcb67959915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:56.618954 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-94fed135-4b5b-4860-a13b-3fcb67959915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:56.619723 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-94fed135-4b5b-4860-a13b-3fcb67959915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:56.770859 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a5f275a5-29ee-4012-aea2-c17b9f433f70 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:56.771632 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a5f275a5-29ee-4012-aea2-c17b9f433f70 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:56.835230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-94fed135-4b5b-4860-a13b-3fcb67959915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:56.844173 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-94fed135-4b5b-4860-a13b-3fcb67959915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.250612 Aug 24 08:56:56.844796 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 122/233] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:56 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:56.876935 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c14e2e43-ac65-4bce-a2bd-bae75c8d6418 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:56.878001 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c14e2e43-ac65-4bce-a2bd-bae75c8d6418 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:56.885665 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c14e2e43-ac65-4bce-a2bd-bae75c8d6418 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:56.886346 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c14e2e43-ac65-4bce-a2bd-bae75c8d6418 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:56.886909 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c14e2e43-ac65-4bce-a2bd-bae75c8d6418 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:56.887743 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c14e2e43-ac65-4bce-a2bd-bae75c8d6418 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:56.888324 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c14e2e43-ac65-4bce-a2bd-bae75c8d6418 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:56.888995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c14e2e43-ac65-4bce-a2bd-bae75c8d6418 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:57.025306 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a5f275a5-29ee-4012-aea2-c17b9f433f70 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:57.038016 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a5f275a5-29ee-4012-aea2-c17b9f433f70 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1213 microversion: 2.1 time: 0.271546 Aug 24 08:56:57.041344 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 112/234] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:56 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1213 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:57.133917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c14e2e43-ac65-4bce-a2bd-bae75c8d6418 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:57.142781 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c14e2e43-ac65-4bce-a2bd-bae75c8d6418 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.271132 Aug 24 08:56:57.143659 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 123/235] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:56 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:57.563166 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-1fa5116b-5ac4-4aaa-b559-e863316809b3 req-f5f27269-42a4-462e-bdef-d1d1ceb80648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abdb5828-315b-4046-9985-95e58a2f24b3", "tag": "756cdfb7-826d-4039-9977-c15d62078dd5"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:57.584119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-1fa5116b-5ac4-4aaa-b559-e863316809b3 req-f5f27269-42a4-462e-bdef-d1d1ceb80648 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:57.586443 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-1fa5116b-5ac4-4aaa-b559-e863316809b3 req-f5f27269-42a4-462e-bdef-d1d1ceb80648 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:57.587017 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-1fa5116b-5ac4-4aaa-b559-e863316809b3 req-f5f27269-42a4-462e-bdef-d1d1ceb80648 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:57.600226 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-1fa5116b-5ac4-4aaa-b559-e863316809b3 req-f5f27269-42a4-462e-bdef-d1d1ceb80648 service nova] Creating event network-changed:756cdfb7-826d-4039-9977-c15d62078dd5 for instance abdb5828-315b-4046-9985-95e58a2f24b3 on hv-cinder-85221 Aug 24 08:56:57.606698 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-1fa5116b-5ac4-4aaa-b559-e863316809b3 req-f5f27269-42a4-462e-bdef-d1d1ceb80648 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047157 Aug 24 08:56:57.609031 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 113/236] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:57.882505 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-177e8fbe-eb2b-420b-a6fc-c4c6c885edb2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:57.883183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-177e8fbe-eb2b-420b-a6fc-c4c6c885edb2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:57.889940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-177e8fbe-eb2b-420b-a6fc-c4c6c885edb2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:57.890420 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-177e8fbe-eb2b-420b-a6fc-c4c6c885edb2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:57.890843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-177e8fbe-eb2b-420b-a6fc-c4c6c885edb2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:57.891635 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-177e8fbe-eb2b-420b-a6fc-c4c6c885edb2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:57.892042 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-177e8fbe-eb2b-420b-a6fc-c4c6c885edb2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:57.892464 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-177e8fbe-eb2b-420b-a6fc-c4c6c885edb2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.063063 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-15563c01-25c6-4e07-bda1-237e27719aa6 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:58.064415 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-15563c01-25c6-4e07-bda1-237e27719aa6 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:58.068265 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=97 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:58.068525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-177e8fbe-eb2b-420b-a6fc-c4c6c885edb2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:58.073434 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15563c01-25c6-4e07-bda1-237e27719aa6 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.074520 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15563c01-25c6-4e07-bda1-237e27719aa6 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.075490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15563c01-25c6-4e07-bda1-237e27719aa6 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.076528 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15563c01-25c6-4e07-bda1-237e27719aa6 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.077368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15563c01-25c6-4e07-bda1-237e27719aa6 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.078338 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15563c01-25c6-4e07-bda1-237e27719aa6 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.078531 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-177e8fbe-eb2b-420b-a6fc-c4c6c885edb2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.200573 Aug 24 08:56:58.090802 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 124/237] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:57 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:58.165207 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2470fc6e-ad7f-4de8-8d67-bbae79babf1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:58.165832 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2470fc6e-ad7f-4de8-8d67-bbae79babf1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:58.177105 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2470fc6e-ad7f-4de8-8d67-bbae79babf1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.181957 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2470fc6e-ad7f-4de8-8d67-bbae79babf1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.182776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2470fc6e-ad7f-4de8-8d67-bbae79babf1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.183756 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2470fc6e-ad7f-4de8-8d67-bbae79babf1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.184399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2470fc6e-ad7f-4de8-8d67-bbae79babf1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.185745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2470fc6e-ad7f-4de8-8d67-bbae79babf1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.212202 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-15563c01-25c6-4e07-bda1-237e27719aa6 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:58.220986 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-15563c01-25c6-4e07-bda1-237e27719aa6 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1217 microversion: 2.1 time: 0.162082 Aug 24 08:56:58.223282 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 114/238] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:58 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:58.372960 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2470fc6e-ad7f-4de8-8d67-bbae79babf1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:58.399072 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2470fc6e-ad7f-4de8-8d67-bbae79babf1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1361 microversion: 2.1 time: 0.237857 Aug 24 08:56:58.399727 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 125/239] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:58 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:59.111459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f4d1e4b9-db33-4986-886b-1bd305bed360 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:59.112238 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f4d1e4b9-db33-4986-886b-1bd305bed360 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:59.122974 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f4d1e4b9-db33-4986-886b-1bd305bed360 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.123608 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f4d1e4b9-db33-4986-886b-1bd305bed360 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.124054 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f4d1e4b9-db33-4986-886b-1bd305bed360 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.125411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f4d1e4b9-db33-4986-886b-1bd305bed360 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.125885 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f4d1e4b9-db33-4986-886b-1bd305bed360 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.126309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f4d1e4b9-db33-4986-886b-1bd305bed360 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.261197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3c91b91b-f3da-492f-86eb-90115016fd69 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:59.261840 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3c91b91b-f3da-492f-86eb-90115016fd69 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:59.272848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c91b91b-f3da-492f-86eb-90115016fd69 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.273351 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c91b91b-f3da-492f-86eb-90115016fd69 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.273791 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c91b91b-f3da-492f-86eb-90115016fd69 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.274676 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c91b91b-f3da-492f-86eb-90115016fd69 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.275108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c91b91b-f3da-492f-86eb-90115016fd69 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.275535 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c91b91b-f3da-492f-86eb-90115016fd69 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.296513 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f4d1e4b9-db33-4986-886b-1bd305bed360 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:59.305332 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f4d1e4b9-db33-4986-886b-1bd305bed360 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1321 microversion: 2.1 time: 0.198964 Aug 24 08:56:59.305960 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 115/240] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:59 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:59.364894 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3c91b91b-f3da-492f-86eb-90115016fd69 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:59.373409 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3c91b91b-f3da-492f-86eb-90115016fd69 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1209 microversion: 2.1 time: 0.116215 Aug 24 08:56:59.387883 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 126/241] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:59 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1209 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:59.427954 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-845e92e5-a7f3-4dea-9388-9d20cf620ded tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:59.428819 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-845e92e5-a7f3-4dea-9388-9d20cf620ded tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:59.437558 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-845e92e5-a7f3-4dea-9388-9d20cf620ded tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.448042 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-845e92e5-a7f3-4dea-9388-9d20cf620ded tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.448042 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-845e92e5-a7f3-4dea-9388-9d20cf620ded tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.448042 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-845e92e5-a7f3-4dea-9388-9d20cf620ded tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.448042 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-845e92e5-a7f3-4dea-9388-9d20cf620ded tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.448632 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-845e92e5-a7f3-4dea-9388-9d20cf620ded tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.625984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-845e92e5-a7f3-4dea-9388-9d20cf620ded tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:59.651786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-845e92e5-a7f3-4dea-9388-9d20cf620ded tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1546 microversion: 2.1 time: 0.227104 Aug 24 08:56:59.665178 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-5e969e48-b102-4ba3-814f-592c8d5e9d62 req-eaa2f528-c777-48ca-bdde-ed3118e9985f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635351cd-1139-4659-9d13-086372a9af7c", "tag": "4ab0306a-2019-48d9-9e7f-8476d77391d3"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:59.670384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 116/242] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:59 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1546 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:59.679417 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ac824868-c805-4925-8703-0507815607e4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:59.682645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ac824868-c805-4925-8703-0507815607e4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:59.689468 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac824868-c805-4925-8703-0507815607e4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.690050 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-5e969e48-b102-4ba3-814f-592c8d5e9d62 req-eaa2f528-c777-48ca-bdde-ed3118e9985f service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.690401 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac824868-c805-4925-8703-0507815607e4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.690539 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-5e969e48-b102-4ba3-814f-592c8d5e9d62 req-eaa2f528-c777-48ca-bdde-ed3118e9985f service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.690981 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-5e969e48-b102-4ba3-814f-592c8d5e9d62 req-eaa2f528-c777-48ca-bdde-ed3118e9985f service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.691848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac824868-c805-4925-8703-0507815607e4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.692848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac824868-c805-4925-8703-0507815607e4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.693479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac824868-c805-4925-8703-0507815607e4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.694049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac824868-c805-4925-8703-0507815607e4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.722159 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-5e969e48-b102-4ba3-814f-592c8d5e9d62 req-eaa2f528-c777-48ca-bdde-ed3118e9985f service nova] Creating event network-changed:4ab0306a-2019-48d9-9e7f-8476d77391d3 for instance 635351cd-1139-4659-9d13-086372a9af7c on hv-cinder-85221 Aug 24 08:56:59.736174 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-5e969e48-b102-4ba3-814f-592c8d5e9d62 req-eaa2f528-c777-48ca-bdde-ed3118e9985f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083161 Aug 24 08:56:59.737181 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 127/243] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:59.830260 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ac824868-c805-4925-8703-0507815607e4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155946 Aug 24 08:56:59.830833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 117/244] 10.222.0.55 () {58 vars in 1275 bytes} [Wed Aug 24 08:56:59 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:00.327971 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1cd2b874-f4d3-4f43-a726-085969ed38af tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:00.329017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1cd2b874-f4d3-4f43-a726-085969ed38af tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:00.369739 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1cd2b874-f4d3-4f43-a726-085969ed38af tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.369739 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1cd2b874-f4d3-4f43-a726-085969ed38af tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.369739 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1cd2b874-f4d3-4f43-a726-085969ed38af tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.369739 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1cd2b874-f4d3-4f43-a726-085969ed38af tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.370349 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1cd2b874-f4d3-4f43-a726-085969ed38af tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.370349 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1cd2b874-f4d3-4f43-a726-085969ed38af tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.396256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-824b9455-6d59-4535-9c88-30af455cb43b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:00.397118 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-824b9455-6d59-4535-9c88-30af455cb43b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:00.403759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-824b9455-6d59-4535-9c88-30af455cb43b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.404510 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-824b9455-6d59-4535-9c88-30af455cb43b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.405211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-824b9455-6d59-4535-9c88-30af455cb43b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.405996 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-824b9455-6d59-4535-9c88-30af455cb43b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.406439 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-824b9455-6d59-4535-9c88-30af455cb43b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.406858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-824b9455-6d59-4535-9c88-30af455cb43b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.473597 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-824b9455-6d59-4535-9c88-30af455cb43b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:00.482625 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-824b9455-6d59-4535-9c88-30af455cb43b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1209 microversion: 2.1 time: 0.091490 Aug 24 08:57:00.483216 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 118/245] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:00 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:00.486071 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1cd2b874-f4d3-4f43-a726-085969ed38af tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:00.494404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1cd2b874-f4d3-4f43-a726-085969ed38af tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1516 microversion: 2.1 time: 0.171378 Aug 24 08:57:00.496013 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 128/246] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:00 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:00.523042 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-67526a70-050b-48c4-bcdc-fec3ba2f49bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:00.525695 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-67526a70-050b-48c4-bcdc-fec3ba2f49bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:00.535683 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67526a70-050b-48c4-bcdc-fec3ba2f49bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.536392 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67526a70-050b-48c4-bcdc-fec3ba2f49bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.537025 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67526a70-050b-48c4-bcdc-fec3ba2f49bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.537969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67526a70-050b-48c4-bcdc-fec3ba2f49bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.538575 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67526a70-050b-48c4-bcdc-fec3ba2f49bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.539134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67526a70-050b-48c4-bcdc-fec3ba2f49bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.575775 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-67526a70-050b-48c4-bcdc-fec3ba2f49bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lazy-loading 'flavor' on Instance uuid 91522d87-2654-4cee-9b8c-b7431ed55dd3 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:57:00.605592 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:01.321710 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-67526a70-050b-48c4-bcdc-fec3ba2f49bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "POST /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3/action" status: 200 len: 32 microversion: 2.1 time: 0.803022 Aug 24 08:57:01.322544 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 119/247] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 08:57:00 2022] POST /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3/action => generated 32 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 08:57:01.333275 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f81e9d94-740a-42c4-919b-3c4a45cfb915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:01.334053 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f81e9d94-740a-42c4-919b-3c4a45cfb915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:01.341932 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f81e9d94-740a-42c4-919b-3c4a45cfb915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:01.342399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f81e9d94-740a-42c4-919b-3c4a45cfb915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:01.342833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f81e9d94-740a-42c4-919b-3c4a45cfb915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:01.343574 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f81e9d94-740a-42c4-919b-3c4a45cfb915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:01.358673 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f81e9d94-740a-42c4-919b-3c4a45cfb915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:01.358673 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f81e9d94-740a-42c4-919b-3c4a45cfb915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:01.507001 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-86f6317e-be74-4e65-91f4-ae1cd7bdea13 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:01.507700 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-86f6317e-be74-4e65-91f4-ae1cd7bdea13 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:01.515550 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-86f6317e-be74-4e65-91f4-ae1cd7bdea13 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:01.516298 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-86f6317e-be74-4e65-91f4-ae1cd7bdea13 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:01.517458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-86f6317e-be74-4e65-91f4-ae1cd7bdea13 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:01.518361 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-86f6317e-be74-4e65-91f4-ae1cd7bdea13 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:01.518980 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-86f6317e-be74-4e65-91f4-ae1cd7bdea13 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:01.520058 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-86f6317e-be74-4e65-91f4-ae1cd7bdea13 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:01.576390 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f81e9d94-740a-42c4-919b-3c4a45cfb915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:01.585778 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f81e9d94-740a-42c4-919b-3c4a45cfb915 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.257456 Aug 24 08:57:01.599220 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 129/248] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:01 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:01.606210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-86f6317e-be74-4e65-91f4-ae1cd7bdea13 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:01.617007 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-86f6317e-be74-4e65-91f4-ae1cd7bdea13 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1265 microversion: 2.1 time: 0.116277 Aug 24 08:57:01.617958 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 120/249] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:01 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:01.768426 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-9fc60fe6-cb2d-4fa2-b79a-f3be953ce583 req-fe1ddb22-b9b9-432e-a868-a1316b2f5887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a46236b-ed03-4f8e-8eba-3d04a06056a1", "tag": "53dc34cd-6619-41da-8d76-3a1724dbcce6"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:01.781028 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-9fc60fe6-cb2d-4fa2-b79a-f3be953ce583 req-fe1ddb22-b9b9-432e-a868-a1316b2f5887 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:01.781919 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-9fc60fe6-cb2d-4fa2-b79a-f3be953ce583 req-fe1ddb22-b9b9-432e-a868-a1316b2f5887 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:01.782771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-9fc60fe6-cb2d-4fa2-b79a-f3be953ce583 req-fe1ddb22-b9b9-432e-a868-a1316b2f5887 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:01.799890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-9fc60fe6-cb2d-4fa2-b79a-f3be953ce583 req-fe1ddb22-b9b9-432e-a868-a1316b2f5887 service nova] Creating event network-changed:53dc34cd-6619-41da-8d76-3a1724dbcce6 for instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 on hv-cinder-85221 Aug 24 08:57:01.809128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-9fc60fe6-cb2d-4fa2-b79a-f3be953ce583 req-fe1ddb22-b9b9-432e-a868-a1316b2f5887 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046743 Aug 24 08:57:01.810133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 130/250] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:57:02.610516 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3de0ecd9-e6b5-4a65-8c07-0e92ffd909aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:02.611248 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3de0ecd9-e6b5-4a65-8c07-0e92ffd909aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:02.624075 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3de0ecd9-e6b5-4a65-8c07-0e92ffd909aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:02.624961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3de0ecd9-e6b5-4a65-8c07-0e92ffd909aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:02.625506 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3de0ecd9-e6b5-4a65-8c07-0e92ffd909aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:02.626684 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3de0ecd9-e6b5-4a65-8c07-0e92ffd909aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:02.627435 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3de0ecd9-e6b5-4a65-8c07-0e92ffd909aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:02.627978 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3de0ecd9-e6b5-4a65-8c07-0e92ffd909aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:02.644946 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0a521796-2a77-4c45-a499-adba085d8785 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:02.645755 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0a521796-2a77-4c45-a499-adba085d8785 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:02.655891 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0a521796-2a77-4c45-a499-adba085d8785 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:02.656701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0a521796-2a77-4c45-a499-adba085d8785 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:02.659086 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0a521796-2a77-4c45-a499-adba085d8785 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:02.662927 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0a521796-2a77-4c45-a499-adba085d8785 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:02.665812 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0a521796-2a77-4c45-a499-adba085d8785 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:02.666473 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0a521796-2a77-4c45-a499-adba085d8785 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:02.788019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0a521796-2a77-4c45-a499-adba085d8785 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:02.796657 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0a521796-2a77-4c45-a499-adba085d8785 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1265 microversion: 2.1 time: 0.159998 Aug 24 08:57:02.797711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 131/251] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:02 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:02.842724 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3de0ecd9-e6b5-4a65-8c07-0e92ffd909aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:02.850996 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3de0ecd9-e6b5-4a65-8c07-0e92ffd909aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.247401 Aug 24 08:57:02.851653 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 121/252] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:02 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:03.818913 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-483fe515-8cde-4fa0-a257-adb3fb1bb08e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:03.820925 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-483fe515-8cde-4fa0-a257-adb3fb1bb08e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:03.828651 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-483fe515-8cde-4fa0-a257-adb3fb1bb08e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:03.830499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-483fe515-8cde-4fa0-a257-adb3fb1bb08e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:03.830499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-483fe515-8cde-4fa0-a257-adb3fb1bb08e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:03.830499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-483fe515-8cde-4fa0-a257-adb3fb1bb08e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:03.830984 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-483fe515-8cde-4fa0-a257-adb3fb1bb08e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:03.831398 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-483fe515-8cde-4fa0-a257-adb3fb1bb08e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:03.877222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d42492db-96db-4e28-9260-f0020d258555 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:03.879877 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d42492db-96db-4e28-9260-f0020d258555 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:03.905132 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d42492db-96db-4e28-9260-f0020d258555 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:03.906548 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d42492db-96db-4e28-9260-f0020d258555 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:03.907264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d42492db-96db-4e28-9260-f0020d258555 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:03.910547 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d42492db-96db-4e28-9260-f0020d258555 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:03.910547 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d42492db-96db-4e28-9260-f0020d258555 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:03.910547 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d42492db-96db-4e28-9260-f0020d258555 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:03.957593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-483fe515-8cde-4fa0-a257-adb3fb1bb08e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:03.966183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-483fe515-8cde-4fa0-a257-adb3fb1bb08e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1265 microversion: 2.1 time: 0.151542 Aug 24 08:57:03.966694 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 132/253] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:03 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:04.107179 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d42492db-96db-4e28-9260-f0020d258555 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:04.116373 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d42492db-96db-4e28-9260-f0020d258555 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.248383 Aug 24 08:57:04.117110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 122/254] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:03 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:04.989857 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ce3e12f2-9417-4480-aef0-f3ed005bbba1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:04.991459 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ce3e12f2-9417-4480-aef0-f3ed005bbba1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:04.994608 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:05.012235 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ce3e12f2-9417-4480-aef0-f3ed005bbba1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.012769 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ce3e12f2-9417-4480-aef0-f3ed005bbba1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.015174 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ce3e12f2-9417-4480-aef0-f3ed005bbba1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:05.018462 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ce3e12f2-9417-4480-aef0-f3ed005bbba1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.019088 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ce3e12f2-9417-4480-aef0-f3ed005bbba1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.019540 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ce3e12f2-9417-4480-aef0-f3ed005bbba1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:05.117257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ce3e12f2-9417-4480-aef0-f3ed005bbba1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:05.126324 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ce3e12f2-9417-4480-aef0-f3ed005bbba1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1271 microversion: 2.1 time: 0.141876 Aug 24 08:57:05.127519 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 133/255] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:04 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1271 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:05.143900 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-787f9180-f2ad-4176-85d0-7734b56380ff tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:05.145170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-787f9180-f2ad-4176-85d0-7734b56380ff tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:05.152830 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-787f9180-f2ad-4176-85d0-7734b56380ff tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.155085 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-787f9180-f2ad-4176-85d0-7734b56380ff tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.155398 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-787f9180-f2ad-4176-85d0-7734b56380ff tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:05.156303 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-787f9180-f2ad-4176-85d0-7734b56380ff tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.157013 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-787f9180-f2ad-4176-85d0-7734b56380ff tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.158051 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-787f9180-f2ad-4176-85d0-7734b56380ff tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:05.544869 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-787f9180-f2ad-4176-85d0-7734b56380ff tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:05.556432 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-787f9180-f2ad-4176-85d0-7734b56380ff tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.419811 Aug 24 08:57:05.567457 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 123/256] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:05 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:05.926426 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0078da05-15e0-4189-96bc-cd5c7acc8a36 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:05.927276 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0078da05-15e0-4189-96bc-cd5c7acc8a36 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:05.934193 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=8 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:05.935978 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0078da05-15e0-4189-96bc-cd5c7acc8a36 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.936643 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0078da05-15e0-4189-96bc-cd5c7acc8a36 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.937253 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0078da05-15e0-4189-96bc-cd5c7acc8a36 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:05.938146 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0078da05-15e0-4189-96bc-cd5c7acc8a36 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.938753 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0078da05-15e0-4189-96bc-cd5c7acc8a36 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.939475 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0078da05-15e0-4189-96bc-cd5c7acc8a36 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:05.969090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0078da05-15e0-4189-96bc-cd5c7acc8a36 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Going to try to terminate instance {{(pid=132984) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:57:05.992595 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:06.125750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-174704533", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "networks": [{"uuid": "b4172a38-41d9-4fdc-b2fb-3c15555d55f7"}]}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:06.207047 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.network.neutron [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] validate_networks() for [('b4172a38-41d9-4fdc-b2fb-3c15555d55f7', None, None, None, None, None)] {{(pid=132985) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:57:06.366620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0078da05-15e0-4189-96bc-cd5c7acc8a36 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "DELETE /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 204 len: 0 microversion: 2.1 time: 0.444734 Aug 24 08:57:06.367695 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 134/257] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 08:57:05 2022] DELETE /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:57:06.373271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-72b72ea8-9e5c-431b-a7c3-1791f92f4975 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:06.381595 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-72b72ea8-9e5c-431b-a7c3-1791f92f4975 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:06.381595 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-72b72ea8-9e5c-431b-a7c3-1791f92f4975 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.382052 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-72b72ea8-9e5c-431b-a7c3-1791f92f4975 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.382489 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-72b72ea8-9e5c-431b-a7c3-1791f92f4975 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.383251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-72b72ea8-9e5c-431b-a7c3-1791f92f4975 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.383703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-72b72ea8-9e5c-431b-a7c3-1791f92f4975 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.384123 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-72b72ea8-9e5c-431b-a7c3-1791f92f4975 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.601105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Flavor limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:57:06.601105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Image limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:57:06.601105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Flavor pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:57:06.601105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Image pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:57:06.601105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:57:06.610320 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.610794 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.611219 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.612027 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.612469 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.613548 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.622017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-72b72ea8-9e5c-431b-a7c3-1791f92f4975 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:06.631309 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-72b72ea8-9e5c-431b-a7c3-1791f92f4975 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1313 microversion: 2.1 time: 0.262384 Aug 24 08:57:06.631893 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 135/258] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:06 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:06.636311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Getting quotas for project c1977f516dfe40f7b26ffae80d68edd9. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:57:06.636996 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d4071ae8-8e24-4640-aee8-ed035461cd99 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:06.637608 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d4071ae8-8e24-4640-aee8-ed035461cd99 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:06.643015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Getting quotas for user c11f1ac1772b46d2a03165571edb6f10 and project c1977f516dfe40f7b26ffae80d68edd9. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:57:06.643574 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4071ae8-8e24-4640-aee8-ed035461cd99 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.644305 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4071ae8-8e24-4640-aee8-ed035461cd99 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.644933 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4071ae8-8e24-4640-aee8-ed035461cd99 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.645784 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4071ae8-8e24-4640-aee8-ed035461cd99 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.646453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4071ae8-8e24-4640-aee8-ed035461cd99 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.646881 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4071ae8-8e24-4640-aee8-ed035461cd99 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.656761 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Going to run 1 instances... {{(pid=132985) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:57:06.659143 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:57:06.811839 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d4071ae8-8e24-4640-aee8-ed035461cd99 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:06.822766 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d4071ae8-8e24-4640-aee8-ed035461cd99 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1553 microversion: 2.1 time: 0.189318 Aug 24 08:57:06.836961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 136/259] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:06 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:06.841480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2dc2fbed-8273-4de1-8fbd-bda10864a249 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:06.842106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2dc2fbed-8273-4de1-8fbd-bda10864a249 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:06.849186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2dc2fbed-8273-4de1-8fbd-bda10864a249 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.849675 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2dc2fbed-8273-4de1-8fbd-bda10864a249 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.850128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2dc2fbed-8273-4de1-8fbd-bda10864a249 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.850946 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2dc2fbed-8273-4de1-8fbd-bda10864a249 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.851431 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2dc2fbed-8273-4de1-8fbd-bda10864a249 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.869124 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2dc2fbed-8273-4de1-8fbd-bda10864a249 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.869433 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-dc39fb41-fc6f-4f4b-9e6e-9274e1b2c9bf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733739 Aug 24 08:57:06.869433 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 124/260] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 08:57:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 08:57:06.881753 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-de3fdee1-f0a3-4a80-91be-b2c2d934b8f8 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:06.882585 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-de3fdee1-f0a3-4a80-91be-b2c2d934b8f8 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:06.960432 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-de3fdee1-f0a3-4a80-91be-b2c2d934b8f8 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:06.969420 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-de3fdee1-f0a3-4a80-91be-b2c2d934b8f8 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1218 microversion: 2.1 time: 0.093637 Aug 24 08:57:06.970602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 125/261] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:06 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:06.975944 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-52c6879e-a63a-4f53-a36d-7100720fecbd req-53e43395-f668-4c8f-b26b-f624d9467a9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a832696d-f49f-42ae-88b9-339966f7523a", "tag": "c077090b-d32a-44fa-a33b-c34bce6cba0e"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:06.986909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-52c6879e-a63a-4f53-a36d-7100720fecbd req-53e43395-f668-4c8f-b26b-f624d9467a9d service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.987689 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-52c6879e-a63a-4f53-a36d-7100720fecbd req-53e43395-f668-4c8f-b26b-f624d9467a9d service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.988449 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-52c6879e-a63a-4f53-a36d-7100720fecbd req-53e43395-f668-4c8f-b26b-f624d9467a9d service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.002916 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-52c6879e-a63a-4f53-a36d-7100720fecbd req-53e43395-f668-4c8f-b26b-f624d9467a9d service nova] Creating event network-changed:c077090b-d32a-44fa-a33b-c34bce6cba0e for instance a832696d-f49f-42ae-88b9-339966f7523a on hv-cinder-85221 Aug 24 08:57:07.010468 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-52c6879e-a63a-4f53-a36d-7100720fecbd req-53e43395-f668-4c8f-b26b-f624d9467a9d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037864 Aug 24 08:57:07.011573 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 126/262] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:07.083974 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2dc2fbed-8273-4de1-8fbd-bda10864a249 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:07.092702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2dc2fbed-8273-4de1-8fbd-bda10864a249 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.268170 Aug 24 08:57:07.093396 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 137/263] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:06 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:07.653497 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8a94bf5a-7dab-4556-a2ba-98f0ba2b680c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:07.654369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8a94bf5a-7dab-4556-a2ba-98f0ba2b680c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:07.661140 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8a94bf5a-7dab-4556-a2ba-98f0ba2b680c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.661625 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8a94bf5a-7dab-4556-a2ba-98f0ba2b680c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.662061 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8a94bf5a-7dab-4556-a2ba-98f0ba2b680c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.662796 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8a94bf5a-7dab-4556-a2ba-98f0ba2b680c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.663247 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8a94bf5a-7dab-4556-a2ba-98f0ba2b680c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.663665 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8a94bf5a-7dab-4556-a2ba-98f0ba2b680c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.834741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8a94bf5a-7dab-4556-a2ba-98f0ba2b680c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:07.844008 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8a94bf5a-7dab-4556-a2ba-98f0ba2b680c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1313 microversion: 2.1 time: 0.194843 Aug 24 08:57:07.844968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 127/264] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:07 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:07.851211 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d8938dc9-9b2b-4d67-a840-6102295f5eb0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:07.852591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d8938dc9-9b2b-4d67-a840-6102295f5eb0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:07.866498 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d8938dc9-9b2b-4d67-a840-6102295f5eb0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.866498 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d8938dc9-9b2b-4d67-a840-6102295f5eb0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.866498 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d8938dc9-9b2b-4d67-a840-6102295f5eb0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.866498 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d8938dc9-9b2b-4d67-a840-6102295f5eb0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.866830 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d8938dc9-9b2b-4d67-a840-6102295f5eb0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.866830 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d8938dc9-9b2b-4d67-a840-6102295f5eb0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:08.006673 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1742a613-80b1-497d-b69d-c772e0b080f5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:08.007540 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1742a613-80b1-497d-b69d-c772e0b080f5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:08.026515 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d8938dc9-9b2b-4d67-a840-6102295f5eb0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:08.039555 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d8938dc9-9b2b-4d67-a840-6102295f5eb0 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1553 microversion: 2.1 time: 0.195851 Aug 24 08:57:08.040160 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 138/265] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:07 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:08.065479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1742a613-80b1-497d-b69d-c772e0b080f5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:08.073017 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1742a613-80b1-497d-b69d-c772e0b080f5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1218 microversion: 2.1 time: 0.070175 Aug 24 08:57:08.073588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 128/266] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:08 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:08.125930 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9c5eda47-98c3-4232-a13c-99b51da960fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:08.126974 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9c5eda47-98c3-4232-a13c-99b51da960fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:08.135620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c5eda47-98c3-4232-a13c-99b51da960fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:08.136108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c5eda47-98c3-4232-a13c-99b51da960fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:08.136737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c5eda47-98c3-4232-a13c-99b51da960fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:08.137471 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c5eda47-98c3-4232-a13c-99b51da960fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:08.137920 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c5eda47-98c3-4232-a13c-99b51da960fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:08.138340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c5eda47-98c3-4232-a13c-99b51da960fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:08.391393 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9c5eda47-98c3-4232-a13c-99b51da960fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:08.403489 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9c5eda47-98c3-4232-a13c-99b51da960fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.281230 Aug 24 08:57:08.404600 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 139/267] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:08 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:08.866229 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ad57717e-1efb-43d9-b368-0c179e2ef71f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:08.866947 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ad57717e-1efb-43d9-b368-0c179e2ef71f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:08.873797 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad57717e-1efb-43d9-b368-0c179e2ef71f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:08.874293 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad57717e-1efb-43d9-b368-0c179e2ef71f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:08.874727 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad57717e-1efb-43d9-b368-0c179e2ef71f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:08.875438 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad57717e-1efb-43d9-b368-0c179e2ef71f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:08.875901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad57717e-1efb-43d9-b368-0c179e2ef71f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:08.876324 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad57717e-1efb-43d9-b368-0c179e2ef71f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.062054 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3b01f756-f043-4207-8e25-e1eeb2134a73 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:09.063169 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3b01f756-f043-4207-8e25-e1eeb2134a73 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:09.070985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b01f756-f043-4207-8e25-e1eeb2134a73 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.071647 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b01f756-f043-4207-8e25-e1eeb2134a73 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.072272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b01f756-f043-4207-8e25-e1eeb2134a73 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.073276 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b01f756-f043-4207-8e25-e1eeb2134a73 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.073930 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b01f756-f043-4207-8e25-e1eeb2134a73 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.074369 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b01f756-f043-4207-8e25-e1eeb2134a73 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.084293 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ad57717e-1efb-43d9-b368-0c179e2ef71f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:09.100058 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ad57717e-1efb-43d9-b368-0c179e2ef71f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1313 microversion: 2.1 time: 0.237787 Aug 24 08:57:09.101863 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 129/268] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:08 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:09.111686 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-dc65b56d-4716-48ed-98df-1afae37672c5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:09.113843 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-dc65b56d-4716-48ed-98df-1afae37672c5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:09.127439 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc65b56d-4716-48ed-98df-1afae37672c5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.128364 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc65b56d-4716-48ed-98df-1afae37672c5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.129819 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc65b56d-4716-48ed-98df-1afae37672c5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.131052 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc65b56d-4716-48ed-98df-1afae37672c5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.131871 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc65b56d-4716-48ed-98df-1afae37672c5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.132677 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc65b56d-4716-48ed-98df-1afae37672c5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.235531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-dc65b56d-4716-48ed-98df-1afae37672c5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:09.244377 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-dc65b56d-4716-48ed-98df-1afae37672c5 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1214 microversion: 2.1 time: 0.140560 Aug 24 08:57:09.245294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 130/269] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:09 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:09.268851 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3b01f756-f043-4207-8e25-e1eeb2134a73 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:09.281320 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3b01f756-f043-4207-8e25-e1eeb2134a73 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1553 microversion: 2.1 time: 0.223434 Aug 24 08:57:09.281901 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 140/270] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:09 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:09.437122 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a9271395-fb03-4c93-bf26-3da079f29a30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:09.438019 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a9271395-fb03-4c93-bf26-3da079f29a30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:09.447921 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a9271395-fb03-4c93-bf26-3da079f29a30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.449018 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a9271395-fb03-4c93-bf26-3da079f29a30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.449971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a9271395-fb03-4c93-bf26-3da079f29a30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.451378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a9271395-fb03-4c93-bf26-3da079f29a30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.452909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a9271395-fb03-4c93-bf26-3da079f29a30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.454089 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a9271395-fb03-4c93-bf26-3da079f29a30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.741485 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a9271395-fb03-4c93-bf26-3da079f29a30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:09.763202 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a9271395-fb03-4c93-bf26-3da079f29a30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.330253 Aug 24 08:57:09.764509 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 131/271] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:09 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:10.113011 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-cc1b13b6-da28-41b3-99b1-ef24db39d1cf req-38c5f423-f75f-4f3b-985c-3ae4914e6b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1ec0c9-cd4b-4256-bc67-975c8dc732c3", "name": "network-vif-deleted", "tag": "6c0c24ef-4f56-4e8d-9dfc-db756eb87f1b"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:10.124435 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-cc1b13b6-da28-41b3-99b1-ef24db39d1cf req-38c5f423-f75f-4f3b-985c-3ae4914e6b10 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.125228 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-cc1b13b6-da28-41b3-99b1-ef24db39d1cf req-38c5f423-f75f-4f3b-985c-3ae4914e6b10 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.125850 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-cc1b13b6-da28-41b3-99b1-ef24db39d1cf req-38c5f423-f75f-4f3b-985c-3ae4914e6b10 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.141899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3738db60-ad03-4c03-a79f-4f4e8f674b75 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:10.143273 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3738db60-ad03-4c03-a79f-4f4e8f674b75 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:10.152110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3738db60-ad03-4c03-a79f-4f4e8f674b75 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.152919 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3738db60-ad03-4c03-a79f-4f4e8f674b75 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.153528 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3738db60-ad03-4c03-a79f-4f4e8f674b75 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.155702 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3738db60-ad03-4c03-a79f-4f4e8f674b75 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.156376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3738db60-ad03-4c03-a79f-4f4e8f674b75 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.157125 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3738db60-ad03-4c03-a79f-4f4e8f674b75 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.303808 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-cc1b13b6-da28-41b3-99b1-ef24db39d1cf req-38c5f423-f75f-4f3b-985c-3ae4914e6b10 service nova] Creating event network-vif-deleted:6c0c24ef-4f56-4e8d-9dfc-db756eb87f1b for instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 on hv-cinder-85221 Aug 24 08:57:10.309254 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-cc1b13b6-da28-41b3-99b1-ef24db39d1cf req-38c5f423-f75f-4f3b-985c-3ae4914e6b10 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200052 Aug 24 08:57:10.310449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 141/272] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:57:10.317874 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-db910bf5-e727-4ad6-acab-7657c842d5a4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:10.318672 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-db910bf5-e727-4ad6-acab-7657c842d5a4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:10.325570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db910bf5-e727-4ad6-acab-7657c842d5a4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.326292 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db910bf5-e727-4ad6-acab-7657c842d5a4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.326918 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db910bf5-e727-4ad6-acab-7657c842d5a4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.327875 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db910bf5-e727-4ad6-acab-7657c842d5a4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.328557 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db910bf5-e727-4ad6-acab-7657c842d5a4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.329219 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db910bf5-e727-4ad6-acab-7657c842d5a4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.372864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3738db60-ad03-4c03-a79f-4f4e8f674b75 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:10.382046 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3738db60-ad03-4c03-a79f-4f4e8f674b75 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1313 microversion: 2.1 time: 0.244356 Aug 24 08:57:10.384077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 132/273] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:10 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:10.387185 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1be4cc6d-5994-4bc3-8a28-293d53d26a66 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:10.387787 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1be4cc6d-5994-4bc3-8a28-293d53d26a66 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:10.393760 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1be4cc6d-5994-4bc3-8a28-293d53d26a66 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.395053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1be4cc6d-5994-4bc3-8a28-293d53d26a66 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.395650 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1be4cc6d-5994-4bc3-8a28-293d53d26a66 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.396374 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1be4cc6d-5994-4bc3-8a28-293d53d26a66 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.396889 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1be4cc6d-5994-4bc3-8a28-293d53d26a66 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.397303 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1be4cc6d-5994-4bc3-8a28-293d53d26a66 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.412000 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-db910bf5-e727-4ad6-acab-7657c842d5a4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:10.420215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-db910bf5-e727-4ad6-acab-7657c842d5a4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1278 microversion: 2.1 time: 0.108315 Aug 24 08:57:10.423637 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 142/274] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:10 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1278 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:10.472884 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1be4cc6d-5994-4bc3-8a28-293d53d26a66 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:10.481607 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1be4cc6d-5994-4bc3-8a28-293d53d26a66 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1511 microversion: 2.1 time: 0.097949 Aug 24 08:57:10.482184 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 133/275] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:10 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1511 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:10.798886 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9d7733c2-79f5-4cb0-ad18-deb76285b91e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:10.799614 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9d7733c2-79f5-4cb0-ad18-deb76285b91e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:10.806988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d7733c2-79f5-4cb0-ad18-deb76285b91e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.807478 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d7733c2-79f5-4cb0-ad18-deb76285b91e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.807921 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d7733c2-79f5-4cb0-ad18-deb76285b91e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.808997 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d7733c2-79f5-4cb0-ad18-deb76285b91e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.809158 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d7733c2-79f5-4cb0-ad18-deb76285b91e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.809545 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d7733c2-79f5-4cb0-ad18-deb76285b91e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.971081 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9d7733c2-79f5-4cb0-ad18-deb76285b91e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:10.980300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9d7733c2-79f5-4cb0-ad18-deb76285b91e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.185415 Aug 24 08:57:10.980984 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 143/276] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:10 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:11.404430 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ce6139f5-bf7e-4734-bf26-848930b33f47 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:11.405871 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ce6139f5-bf7e-4734-bf26-848930b33f47 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:11.412860 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ce6139f5-bf7e-4734-bf26-848930b33f47 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:11.413347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ce6139f5-bf7e-4734-bf26-848930b33f47 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:11.413777 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ce6139f5-bf7e-4734-bf26-848930b33f47 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:11.414648 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ce6139f5-bf7e-4734-bf26-848930b33f47 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:11.414927 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ce6139f5-bf7e-4734-bf26-848930b33f47 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:11.415347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ce6139f5-bf7e-4734-bf26-848930b33f47 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:11.442306 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-926caaba-a033-4c92-86f3-e0bbb7ee0096 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:11.442919 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-926caaba-a033-4c92-86f3-e0bbb7ee0096 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:11.450356 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-926caaba-a033-4c92-86f3-e0bbb7ee0096 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:11.450843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-926caaba-a033-4c92-86f3-e0bbb7ee0096 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:11.451365 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-926caaba-a033-4c92-86f3-e0bbb7ee0096 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:11.452212 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-926caaba-a033-4c92-86f3-e0bbb7ee0096 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:11.452917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-926caaba-a033-4c92-86f3-e0bbb7ee0096 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:11.453493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-926caaba-a033-4c92-86f3-e0bbb7ee0096 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:11.551025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-926caaba-a033-4c92-86f3-e0bbb7ee0096 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:11.573365 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-926caaba-a033-4c92-86f3-e0bbb7ee0096 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1278 microversion: 2.1 time: 0.126639 Aug 24 08:57:11.573365 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 144/277] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:11 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:11.573732 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ce6139f5-bf7e-4734-bf26-848930b33f47 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:11.574136 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-be63d325-1fdc-49e8-bb9e-7f2711e16c97 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:11.575033 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-be63d325-1fdc-49e8-bb9e-7f2711e16c97 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:11.578891 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ce6139f5-bf7e-4734-bf26-848930b33f47 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1313 microversion: 2.1 time: 0.179066 Aug 24 08:57:11.579762 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 134/278] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:11 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:11.585313 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-be63d325-1fdc-49e8-bb9e-7f2711e16c97 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:11.586225 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-be63d325-1fdc-49e8-bb9e-7f2711e16c97 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:11.586695 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-be63d325-1fdc-49e8-bb9e-7f2711e16c97 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:11.587549 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-be63d325-1fdc-49e8-bb9e-7f2711e16c97 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:11.588173 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-be63d325-1fdc-49e8-bb9e-7f2711e16c97 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:11.588683 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-be63d325-1fdc-49e8-bb9e-7f2711e16c97 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:11.659161 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-be63d325-1fdc-49e8-bb9e-7f2711e16c97 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:11.668714 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-be63d325-1fdc-49e8-bb9e-7f2711e16c97 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1511 microversion: 2.1 time: 0.100620 Aug 24 08:57:11.669289 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 145/279] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:11 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1511 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:12.122357 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5901b3b4-9ad5-4894-b623-f49f1501d9c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:12.122357 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5901b3b4-9ad5-4894-b623-f49f1501d9c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:12.122357 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5901b3b4-9ad5-4894-b623-f49f1501d9c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.122357 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5901b3b4-9ad5-4894-b623-f49f1501d9c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.123188 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5901b3b4-9ad5-4894-b623-f49f1501d9c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.123188 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5901b3b4-9ad5-4894-b623-f49f1501d9c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.123188 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5901b3b4-9ad5-4894-b623-f49f1501d9c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.123188 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5901b3b4-9ad5-4894-b623-f49f1501d9c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.158906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5901b3b4-9ad5-4894-b623-f49f1501d9c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:12.166987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5901b3b4-9ad5-4894-b623-f49f1501d9c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.168375 Aug 24 08:57:12.167556 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 135/280] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:11 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:12.587105 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3901461d-db7c-4a33-8841-649176df2c6f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:12.587907 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3901461d-db7c-4a33-8841-649176df2c6f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:12.594556 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3901461d-db7c-4a33-8841-649176df2c6f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.595026 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3901461d-db7c-4a33-8841-649176df2c6f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.595452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3901461d-db7c-4a33-8841-649176df2c6f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.596144 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3901461d-db7c-4a33-8841-649176df2c6f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.596637 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3901461d-db7c-4a33-8841-649176df2c6f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.597039 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3901461d-db7c-4a33-8841-649176df2c6f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.602100 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b60b67bb-8ac2-4488-a583-efa0ae9dd84b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:12.602727 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b60b67bb-8ac2-4488-a583-efa0ae9dd84b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:12.608808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b60b67bb-8ac2-4488-a583-efa0ae9dd84b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.609285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b60b67bb-8ac2-4488-a583-efa0ae9dd84b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.609727 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b60b67bb-8ac2-4488-a583-efa0ae9dd84b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.610405 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b60b67bb-8ac2-4488-a583-efa0ae9dd84b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.610869 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b60b67bb-8ac2-4488-a583-efa0ae9dd84b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.611323 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b60b67bb-8ac2-4488-a583-efa0ae9dd84b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.663323 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3901461d-db7c-4a33-8841-649176df2c6f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:12.674729 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3901461d-db7c-4a33-8841-649176df2c6f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1278 microversion: 2.1 time: 0.092202 Aug 24 08:57:12.681339 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 146/281] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:12 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1278 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:12.692788 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fe331e17-1de2-490b-bad6-3138abeb3a39 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:12.697871 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fe331e17-1de2-490b-bad6-3138abeb3a39 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:12.700684 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe331e17-1de2-490b-bad6-3138abeb3a39 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.701235 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe331e17-1de2-490b-bad6-3138abeb3a39 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.701881 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe331e17-1de2-490b-bad6-3138abeb3a39 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.702863 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe331e17-1de2-490b-bad6-3138abeb3a39 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.703403 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe331e17-1de2-490b-bad6-3138abeb3a39 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.703906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe331e17-1de2-490b-bad6-3138abeb3a39 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.754874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b60b67bb-8ac2-4488-a583-efa0ae9dd84b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:12.763042 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b60b67bb-8ac2-4488-a583-efa0ae9dd84b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1313 microversion: 2.1 time: 0.164923 Aug 24 08:57:12.763623 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 136/282] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:12 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:12.777727 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fe331e17-1de2-490b-bad6-3138abeb3a39 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:12.787231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fe331e17-1de2-490b-bad6-3138abeb3a39 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1511 microversion: 2.1 time: 0.099550 Aug 24 08:57:12.787823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 147/283] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:12 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1511 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:13.189945 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e216732d-7e38-47d6-94ec-3f9b20550e39 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:13.190762 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e216732d-7e38-47d6-94ec-3f9b20550e39 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:13.197492 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e216732d-7e38-47d6-94ec-3f9b20550e39 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.198102 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e216732d-7e38-47d6-94ec-3f9b20550e39 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.198588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e216732d-7e38-47d6-94ec-3f9b20550e39 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.199366 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e216732d-7e38-47d6-94ec-3f9b20550e39 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.199893 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e216732d-7e38-47d6-94ec-3f9b20550e39 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.201432 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e216732d-7e38-47d6-94ec-3f9b20550e39 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.360014 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e216732d-7e38-47d6-94ec-3f9b20550e39 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:13.364407 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:13.369579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e216732d-7e38-47d6-94ec-3f9b20550e39 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.184457 Aug 24 08:57:13.374354 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 137/284] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:13 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:13.695497 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-470cf5dd-b4a4-4840-85d4-589d4b306477 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:13.696124 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-470cf5dd-b4a4-4840-85d4-589d4b306477 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:13.703482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-470cf5dd-b4a4-4840-85d4-589d4b306477 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.703948 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-470cf5dd-b4a4-4840-85d4-589d4b306477 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.704371 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-470cf5dd-b4a4-4840-85d4-589d4b306477 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.705119 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-470cf5dd-b4a4-4840-85d4-589d4b306477 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.705546 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-470cf5dd-b4a4-4840-85d4-589d4b306477 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.705964 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-470cf5dd-b4a4-4840-85d4-589d4b306477 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.785892 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2807982a-df80-4fc0-b5b8-7f3f024a682a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:13.786498 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2807982a-df80-4fc0-b5b8-7f3f024a682a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:13.793618 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2807982a-df80-4fc0-b5b8-7f3f024a682a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.794105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2807982a-df80-4fc0-b5b8-7f3f024a682a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.794563 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2807982a-df80-4fc0-b5b8-7f3f024a682a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.795256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2807982a-df80-4fc0-b5b8-7f3f024a682a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.795708 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2807982a-df80-4fc0-b5b8-7f3f024a682a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.796124 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2807982a-df80-4fc0-b5b8-7f3f024a682a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.880269 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-470cf5dd-b4a4-4840-85d4-589d4b306477 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:13.899846 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-470cf5dd-b4a4-4840-85d4-589d4b306477 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1318 microversion: 2.1 time: 0.207829 Aug 24 08:57:13.908398 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 148/285] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:13 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:13.924145 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:13.932412 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:13.932412 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.933316 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.933925 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.934921 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.935608 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.936200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.963652 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2807982a-df80-4fc0-b5b8-7f3f024a682a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:13.973009 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.973542 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.973974 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.974616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lazy-loading 'fault' on Instance uuid dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:57:13.975854 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2807982a-df80-4fc0-b5b8-7f3f024a682a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1313 microversion: 2.1 time: 0.195437 Aug 24 08:57:13.976947 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 138/286] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:13 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:14.078842 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a0dfdef714e358a74ad8e424b1b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c61eee777c46779632c08ee11946c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:14.089887 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4556353b-e02d-4ad7-8ef8-7157f37b6d63 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 200 len: 1350 microversion: 2.1 time: 0.179673 Aug 24 08:57:14.090615 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 149/287] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:13 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 1350 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:14.391591 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5f95f0f3-b6c2-4b8f-8921-39a324705bfa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:14.392386 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5f95f0f3-b6c2-4b8f-8921-39a324705bfa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:14.399576 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f95f0f3-b6c2-4b8f-8921-39a324705bfa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:14.400062 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f95f0f3-b6c2-4b8f-8921-39a324705bfa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:14.400500 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f95f0f3-b6c2-4b8f-8921-39a324705bfa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:14.401257 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f95f0f3-b6c2-4b8f-8921-39a324705bfa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:14.401713 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f95f0f3-b6c2-4b8f-8921-39a324705bfa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:14.402132 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5f95f0f3-b6c2-4b8f-8921-39a324705bfa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:14.575172 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5f95f0f3-b6c2-4b8f-8921-39a324705bfa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:14.583194 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5f95f0f3-b6c2-4b8f-8921-39a324705bfa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.195551 Aug 24 08:57:14.596999 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 139/288] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:14 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:14.809121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-99659e99-dcc4-4703-bf90-db2e046b63cb req-2a0a78c1-63fb-4614-916e-fb013945a443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e11c5e20-10df-4e90-9cbe-7ca8cdf061d7", "tag": "32104588-8907-4ad0-b7dd-d6cd37053597"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:14.821207 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-99659e99-dcc4-4703-bf90-db2e046b63cb req-2a0a78c1-63fb-4614-916e-fb013945a443 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:14.827704 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-99659e99-dcc4-4703-bf90-db2e046b63cb req-2a0a78c1-63fb-4614-916e-fb013945a443 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:14.827704 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-99659e99-dcc4-4703-bf90-db2e046b63cb req-2a0a78c1-63fb-4614-916e-fb013945a443 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:14.835589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-99659e99-dcc4-4703-bf90-db2e046b63cb req-2a0a78c1-63fb-4614-916e-fb013945a443 service nova] Creating event network-changed:32104588-8907-4ad0-b7dd-d6cd37053597 for instance e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 on hv-cinder-85221 Aug 24 08:57:14.841045 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-99659e99-dcc4-4703-bf90-db2e046b63cb req-2a0a78c1-63fb-4614-916e-fb013945a443 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035735 Aug 24 08:57:14.841645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 150/289] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:14.937152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-13b3b0aa-1940-4eaf-beeb-0dd60db69eef tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:14.942281 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-13b3b0aa-1940-4eaf-beeb-0dd60db69eef tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:14.951122 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13b3b0aa-1940-4eaf-beeb-0dd60db69eef tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:14.952479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13b3b0aa-1940-4eaf-beeb-0dd60db69eef tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:14.954211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13b3b0aa-1940-4eaf-beeb-0dd60db69eef tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:14.955749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13b3b0aa-1940-4eaf-beeb-0dd60db69eef tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:14.956800 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13b3b0aa-1940-4eaf-beeb-0dd60db69eef tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:14.959176 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13b3b0aa-1940-4eaf-beeb-0dd60db69eef tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.005256 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ec91a1c4-e5fe-43de-8609-4d54ccf77ff7 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:15.007091 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ec91a1c4-e5fe-43de-8609-4d54ccf77ff7 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:15.020753 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec91a1c4-e5fe-43de-8609-4d54ccf77ff7 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.022576 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec91a1c4-e5fe-43de-8609-4d54ccf77ff7 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.022878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec91a1c4-e5fe-43de-8609-4d54ccf77ff7 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.024396 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec91a1c4-e5fe-43de-8609-4d54ccf77ff7 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.025478 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec91a1c4-e5fe-43de-8609-4d54ccf77ff7 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.026650 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec91a1c4-e5fe-43de-8609-4d54ccf77ff7 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.055598 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:15.166635 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-13b3b0aa-1940-4eaf-beeb-0dd60db69eef tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:15.179131 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-13b3b0aa-1940-4eaf-beeb-0dd60db69eef tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1318 microversion: 2.1 time: 0.250740 Aug 24 08:57:15.185139 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 140/290] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:14 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:15.194639 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-bdb191df-ca7d-4e28-923d-a15e8815f270 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:15.201095 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-bdb191df-ca7d-4e28-923d-a15e8815f270 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:15.211112 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bdb191df-ca7d-4e28-923d-a15e8815f270 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.211608 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bdb191df-ca7d-4e28-923d-a15e8815f270 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.212072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bdb191df-ca7d-4e28-923d-a15e8815f270 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.212816 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bdb191df-ca7d-4e28-923d-a15e8815f270 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.213265 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bdb191df-ca7d-4e28-923d-a15e8815f270 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.213680 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bdb191df-ca7d-4e28-923d-a15e8815f270 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.229439 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-bdb191df-ca7d-4e28-923d-a15e8815f270 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] HTTP exception thrown: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-bdb191df-ca7d-4e28-923d-a15e8815f270 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Request method failure captured: Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 HTTP/1.1 Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeKYxPS9J93aDAOpp8nVMy4yc8_t1Xmk0_ZoGB3h2GmAZlxSgw9CG05qfZ5bKZcuwSvPMZt5LUJHrwH4NyCbe01YFmsFTh-MwkWYjFM1FqOPFq2dtXrBvI1UEtEGEYl7YgskyPQ_MvAyMhiFYotGBDiM0xD844oc819ZHobO_D5AeQ Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: d0c61eee777c46779632c08ee11946c5 Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-DeleteServersTestJSON-311091362 Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 08:57:15.235072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 08:57:15.236737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d0c61eee777c46779632c08ee11946c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d0c61eee777c46779632c08ee11946c5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0c61eee777c46779632c08ee11946c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0c61eee777c46779632c08ee11946c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:57:15.236737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-DeleteServersTestJSON-311091362 Aug 24 08:57:15.236737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: d0c61eee777c46779632c08ee11946c5 Aug 24 08:57:15.236737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-DeleteServersTestJSON-311091362 Aug 24 08:57:15.236737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-DeleteServersTestJSON-311091362-project Aug 24 08:57:15.236737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 08:57:15.236737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 08:57:15.236737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 718a0dfdef714e358a74ad8e424b1b8a Aug 24 08:57:15.236737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-DeleteServersTestJSON-311091362-project Aug 24 08:57:15.236737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 08:57:15.236737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:15.236737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': 'dd1ec0c9-cd4b-4256-bc67-975c8dc732c3'} Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:57:15.238207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:15.240961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:15.244053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-bdb191df-ca7d-4e28-923d-a15e8815f270 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Returning 404 to user: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:57:15.245290 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-bdb191df-ca7d-4e28-923d-a15e8815f270 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 404 len: 111 microversion: 2.1 time: 0.059303 Aug 24 08:57:15.247178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 141/291] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:15 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:57:15.361195 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ec91a1c4-e5fe-43de-8609-4d54ccf77ff7 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:15.381070 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ec91a1c4-e5fe-43de-8609-4d54ccf77ff7 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1313 microversion: 2.1 time: 0.378839 Aug 24 08:57:15.383254 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 151/292] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:14 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:15.480725 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-545297d1-9929-40b9-9c36-36d507531b85 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:15.485583 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-545297d1-9929-40b9-9c36-36d507531b85 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:15.496503 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-545297d1-9929-40b9-9c36-36d507531b85 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.497392 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-545297d1-9929-40b9-9c36-36d507531b85 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.498228 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-545297d1-9929-40b9-9c36-36d507531b85 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.499452 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-545297d1-9929-40b9-9c36-36d507531b85 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.500201 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-545297d1-9929-40b9-9c36-36d507531b85 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.501465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-545297d1-9929-40b9-9c36-36d507531b85 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.518683 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-545297d1-9929-40b9-9c36-36d507531b85 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] HTTP exception thrown: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-545297d1-9929-40b9-9c36-36d507531b85 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Request method failure captured: Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3/os-volume_attachments HTTP/1.1 Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeKYxPS9J93aDAOpp8nVMy4yc8_t1Xmk0_ZoGB3h2GmAZlxSgw9CG05qfZ5bKZcuwSvPMZt5LUJHrwH4NyCbe01YFmsFTh-MwkWYjFM1FqOPFq2dtXrBvI1UEtEGEYl7YgskyPQ_MvAyMhiFYotGBDiM0xD844oc819ZHobO_D5AeQ Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: d0c61eee777c46779632c08ee11946c5 Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-DeleteServersTestJSON-311091362 Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 08:57:15.520925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 08:57:15.523370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d0c61eee777c46779632c08ee11946c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d0c61eee777c46779632c08ee11946c5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0c61eee777c46779632c08ee11946c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0c61eee777c46779632c08ee11946c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:57:15.523370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-DeleteServersTestJSON-311091362 Aug 24 08:57:15.523370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: d0c61eee777c46779632c08ee11946c5 Aug 24 08:57:15.523370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-DeleteServersTestJSON-311091362 Aug 24 08:57:15.523370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-DeleteServersTestJSON-311091362-project Aug 24 08:57:15.523370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 08:57:15.523370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 08:57:15.523370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 718a0dfdef714e358a74ad8e424b1b8a Aug 24 08:57:15.523370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-DeleteServersTestJSON-311091362-project Aug 24 08:57:15.523370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 08:57:15.523370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:15.523370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'server_id': 'dd1ec0c9-cd4b-4256-bc67-975c8dc732c3'} Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:57:15.524899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:15.527154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:15.529910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-545297d1-9929-40b9-9c36-36d507531b85 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Returning 404 to user: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:57:15.529910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-545297d1-9929-40b9-9c36-36d507531b85 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049410 Aug 24 08:57:15.529910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 142/293] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 08:57:15 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:57:15.608793 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-41f36b98-d2e6-45dc-a594-dac9f4e6cf94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:15.610360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-41f36b98-d2e6-45dc-a594-dac9f4e6cf94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:15.621613 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41f36b98-d2e6-45dc-a594-dac9f4e6cf94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.622279 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41f36b98-d2e6-45dc-a594-dac9f4e6cf94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.623033 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41f36b98-d2e6-45dc-a594-dac9f4e6cf94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.624450 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41f36b98-d2e6-45dc-a594-dac9f4e6cf94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.625056 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41f36b98-d2e6-45dc-a594-dac9f4e6cf94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.625739 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41f36b98-d2e6-45dc-a594-dac9f4e6cf94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.864999 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-41f36b98-d2e6-45dc-a594-dac9f4e6cf94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:15.873073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-41f36b98-d2e6-45dc-a594-dac9f4e6cf94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.272295 Aug 24 08:57:15.873685 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 152/294] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:15 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:16.203507 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-796a0dc5-ceb1-48fc-b9c3-769c5cb30e2f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:16.204261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-796a0dc5-ceb1-48fc-b9c3-769c5cb30e2f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:16.211566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-796a0dc5-ceb1-48fc-b9c3-769c5cb30e2f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.212054 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-796a0dc5-ceb1-48fc-b9c3-769c5cb30e2f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.212491 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-796a0dc5-ceb1-48fc-b9c3-769c5cb30e2f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.213215 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-796a0dc5-ceb1-48fc-b9c3-769c5cb30e2f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.213667 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-796a0dc5-ceb1-48fc-b9c3-769c5cb30e2f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.214113 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-796a0dc5-ceb1-48fc-b9c3-769c5cb30e2f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.391391 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-796a0dc5-ceb1-48fc-b9c3-769c5cb30e2f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:16.399992 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-796a0dc5-ceb1-48fc-b9c3-769c5cb30e2f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1318 microversion: 2.1 time: 0.200327 Aug 24 08:57:16.400955 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 143/295] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:16 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:16.415800 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3acd71dd-560f-4563-a3b0-fd884481219f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:16.416423 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3acd71dd-560f-4563-a3b0-fd884481219f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:16.422528 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3acd71dd-560f-4563-a3b0-fd884481219f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.423016 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3acd71dd-560f-4563-a3b0-fd884481219f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.423451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3acd71dd-560f-4563-a3b0-fd884481219f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.424160 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3acd71dd-560f-4563-a3b0-fd884481219f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.424760 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3acd71dd-560f-4563-a3b0-fd884481219f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.425155 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3acd71dd-560f-4563-a3b0-fd884481219f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.605001 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3acd71dd-560f-4563-a3b0-fd884481219f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:16.626779 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3acd71dd-560f-4563-a3b0-fd884481219f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1313 microversion: 2.1 time: 0.214595 Aug 24 08:57:16.642475 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 153/296] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:16 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:16.898569 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-206aa933-532a-49c4-8fe8-b5dac1bf4a8b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:16.899616 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-206aa933-532a-49c4-8fe8-b5dac1bf4a8b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:16.902878 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:16.913989 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-206aa933-532a-49c4-8fe8-b5dac1bf4a8b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.913989 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-206aa933-532a-49c4-8fe8-b5dac1bf4a8b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.914901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-206aa933-532a-49c4-8fe8-b5dac1bf4a8b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.916476 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-206aa933-532a-49c4-8fe8-b5dac1bf4a8b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.917329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-206aa933-532a-49c4-8fe8-b5dac1bf4a8b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.918097 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-206aa933-532a-49c4-8fe8-b5dac1bf4a8b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.007793 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a211735d-3029-4d0b-a7fb-a760c849615a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:17.011657 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a211735d-3029-4d0b-a7fb-a760c849615a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:17.016201 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a211735d-3029-4d0b-a7fb-a760c849615a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.016746 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a211735d-3029-4d0b-a7fb-a760c849615a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.017185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a211735d-3029-4d0b-a7fb-a760c849615a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.018318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a211735d-3029-4d0b-a7fb-a760c849615a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.019584 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a211735d-3029-4d0b-a7fb-a760c849615a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.019785 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a211735d-3029-4d0b-a7fb-a760c849615a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.036836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-a211735d-3029-4d0b-a7fb-a760c849615a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] HTTP exception thrown: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a211735d-3029-4d0b-a7fb-a760c849615a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Request method failure captured: Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: DELETE /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 HTTP/1.1 Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeKYxPS9J93aDAOpp8nVMy4yc8_t1Xmk0_ZoGB3h2GmAZlxSgw9CG05qfZ5bKZcuwSvPMZt5LUJHrwH4NyCbe01YFmsFTh-MwkWYjFM1FqOPFq2dtXrBvI1UEtEGEYl7YgskyPQ_MvAyMhiFYotGBDiM0xD844oc819ZHobO_D5AeQ Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: d0c61eee777c46779632c08ee11946c5 Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-DeleteServersTestJSON-311091362 Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 08:57:17.041717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 08:57:17.044057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d0c61eee777c46779632c08ee11946c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d0c61eee777c46779632c08ee11946c5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0c61eee777c46779632c08ee11946c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0c61eee777c46779632c08ee11946c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:57:17.044057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-DeleteServersTestJSON-311091362 Aug 24 08:57:17.044057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: d0c61eee777c46779632c08ee11946c5 Aug 24 08:57:17.044057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-DeleteServersTestJSON-311091362 Aug 24 08:57:17.044057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-DeleteServersTestJSON-311091362-project Aug 24 08:57:17.044057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 08:57:17.044057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 08:57:17.044057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 718a0dfdef714e358a74ad8e424b1b8a Aug 24 08:57:17.044057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-DeleteServersTestJSON-311091362-project Aug 24 08:57:17.044057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 08:57:17.044057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:17.044057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': 'dd1ec0c9-cd4b-4256-bc67-975c8dc732c3'} Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:57:17.044966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:17.046680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:57:17.049827 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a211735d-3029-4d0b-a7fb-a760c849615a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Returning 404 to user: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:57:17.049827 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a211735d-3029-4d0b-a7fb-a760c849615a tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "DELETE /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 404 len: 111 microversion: 2.1 time: 0.039577 Aug 24 08:57:17.049827 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 154/297] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 08:57:17 2022] DELETE /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:57:17.052661 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4417a624-2d16-40e1-9cf8-2db252c99ef7 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:17.052661 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4417a624-2d16-40e1-9cf8-2db252c99ef7 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] [instance: dd1ec0c9-cd4b-4256-bc67-975c8dc732c3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:17.059943 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4417a624-2d16-40e1-9cf8-2db252c99ef7 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.062366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4417a624-2d16-40e1-9cf8-2db252c99ef7 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.062366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4417a624-2d16-40e1-9cf8-2db252c99ef7 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.062366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4417a624-2d16-40e1-9cf8-2db252c99ef7 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.062366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4417a624-2d16-40e1-9cf8-2db252c99ef7 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.063020 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4417a624-2d16-40e1-9cf8-2db252c99ef7 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.078507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-4417a624-2d16-40e1-9cf8-2db252c99ef7 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] HTTP exception thrown: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4417a624-2d16-40e1-9cf8-2db252c99ef7 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Request method failure captured: Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 HTTP/1.1 Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeKYxPS9J93aDAOpp8nVMy4yc8_t1Xmk0_ZoGB3h2GmAZlxSgw9CG05qfZ5bKZcuwSvPMZt5LUJHrwH4NyCbe01YFmsFTh-MwkWYjFM1FqOPFq2dtXrBvI1UEtEGEYl7YgskyPQ_MvAyMhiFYotGBDiM0xD844oc819ZHobO_D5AeQ Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: d0c61eee777c46779632c08ee11946c5 Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-DeleteServersTestJSON-311091362 Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 08:57:17.080427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 08:57:17.082607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d0c61eee777c46779632c08ee11946c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d0c61eee777c46779632c08ee11946c5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0c61eee777c46779632c08ee11946c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0c61eee777c46779632c08ee11946c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:57:17.082607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-DeleteServersTestJSON-311091362 Aug 24 08:57:17.082607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: d0c61eee777c46779632c08ee11946c5 Aug 24 08:57:17.082607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-DeleteServersTestJSON-311091362 Aug 24 08:57:17.082607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-DeleteServersTestJSON-311091362-project Aug 24 08:57:17.082607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 08:57:17.082607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 08:57:17.082607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 718a0dfdef714e358a74ad8e424b1b8a Aug 24 08:57:17.082607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-DeleteServersTestJSON-311091362-project Aug 24 08:57:17.082607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 08:57:17.082607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:17.082607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': 'dd1ec0c9-cd4b-4256-bc67-975c8dc732c3'} Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:57:17.083302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. Aug 24 08:57:17.084530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:57:17.085932 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4417a624-2d16-40e1-9cf8-2db252c99ef7 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] Returning 404 to user: Instance dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:57:17.085932 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4417a624-2d16-40e1-9cf8-2db252c99ef7 tempest-DeleteServersTestJSON-311091362 tempest-DeleteServersTestJSON-311091362-project] 10.222.0.55 "GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3" status: 404 len: 111 microversion: 2.1 time: 0.034084 Aug 24 08:57:17.085932 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 155/298] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:17 2022] GET /compute/v2.1/servers/dd1ec0c9-cd4b-4256-bc67-975c8dc732c3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 08:57:17.360185 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-206aa933-532a-49c4-8fe8-b5dac1bf4a8b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:17.370029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-206aa933-532a-49c4-8fe8-b5dac1bf4a8b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.478460 Aug 24 08:57:17.370741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 144/299] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:16 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:17.423372 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f8523571-201d-4217-893c-a63b459aecbf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:17.424006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f8523571-201d-4217-893c-a63b459aecbf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:17.437698 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f8523571-201d-4217-893c-a63b459aecbf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.438208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f8523571-201d-4217-893c-a63b459aecbf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.438654 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f8523571-201d-4217-893c-a63b459aecbf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.439371 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f8523571-201d-4217-893c-a63b459aecbf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.439828 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f8523571-201d-4217-893c-a63b459aecbf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.440256 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f8523571-201d-4217-893c-a63b459aecbf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.560197 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-45ae514b-8bf8-4bba-bbe0-fa617aeaec7a req-5fe69712-be90-4312-b103-fb1e778f8379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a832696d-f49f-42ae-88b9-339966f7523a", "name": "network-vif-plugged", "status": "completed", "tag": "c077090b-d32a-44fa-a33b-c34bce6cba0e"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:17.571537 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-45ae514b-8bf8-4bba-bbe0-fa617aeaec7a req-5fe69712-be90-4312-b103-fb1e778f8379 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.572107 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-45ae514b-8bf8-4bba-bbe0-fa617aeaec7a req-5fe69712-be90-4312-b103-fb1e778f8379 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.572816 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-45ae514b-8bf8-4bba-bbe0-fa617aeaec7a req-5fe69712-be90-4312-b103-fb1e778f8379 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.586841 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-45ae514b-8bf8-4bba-bbe0-fa617aeaec7a req-5fe69712-be90-4312-b103-fb1e778f8379 service nova] Creating event network-vif-plugged:c077090b-d32a-44fa-a33b-c34bce6cba0e for instance a832696d-f49f-42ae-88b9-339966f7523a on hv-cinder-85221 Aug 24 08:57:17.598246 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-45ae514b-8bf8-4bba-bbe0-fa617aeaec7a req-5fe69712-be90-4312-b103-fb1e778f8379 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041194 Aug 24 08:57:17.598622 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 145/300] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:17.659048 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f8523571-201d-4217-893c-a63b459aecbf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:17.667054 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b214dc7d-d8be-4715-964d-9446a47b1855 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:17.668376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b214dc7d-d8be-4715-964d-9446a47b1855 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:17.677549 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f8523571-201d-4217-893c-a63b459aecbf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1318 microversion: 2.1 time: 0.260040 Aug 24 08:57:17.679989 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b214dc7d-d8be-4715-964d-9446a47b1855 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.680897 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b214dc7d-d8be-4715-964d-9446a47b1855 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.681654 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b214dc7d-d8be-4715-964d-9446a47b1855 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.682906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b214dc7d-d8be-4715-964d-9446a47b1855 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.684091 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b214dc7d-d8be-4715-964d-9446a47b1855 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.688691 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b214dc7d-d8be-4715-964d-9446a47b1855 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.688993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 156/301] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:17 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:18.070865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=12 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:18.244343 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b214dc7d-d8be-4715-964d-9446a47b1855 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:18.255321 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b214dc7d-d8be-4715-964d-9446a47b1855 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1313 microversion: 2.1 time: 0.597409 Aug 24 08:57:18.256200 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 146/302] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:17 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:18.404181 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-573ed084-a1d2-4cfa-851f-2b0e2a5510e6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:18.404837 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-573ed084-a1d2-4cfa-851f-2b0e2a5510e6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:18.411852 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-573ed084-a1d2-4cfa-851f-2b0e2a5510e6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:18.412638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-573ed084-a1d2-4cfa-851f-2b0e2a5510e6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:18.413074 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-573ed084-a1d2-4cfa-851f-2b0e2a5510e6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:18.413977 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-573ed084-a1d2-4cfa-851f-2b0e2a5510e6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:18.414280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-573ed084-a1d2-4cfa-851f-2b0e2a5510e6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:18.414876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-573ed084-a1d2-4cfa-851f-2b0e2a5510e6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:18.599447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-573ed084-a1d2-4cfa-851f-2b0e2a5510e6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:18.610600 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-573ed084-a1d2-4cfa-851f-2b0e2a5510e6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.210809 Aug 24 08:57:18.611616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 157/303] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:18 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:18.712231 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3907640b-02ea-4878-8e66-a722a1af444e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:18.713134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3907640b-02ea-4878-8e66-a722a1af444e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:18.722437 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3907640b-02ea-4878-8e66-a722a1af444e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:18.723564 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3907640b-02ea-4878-8e66-a722a1af444e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:18.724769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3907640b-02ea-4878-8e66-a722a1af444e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:18.726378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3907640b-02ea-4878-8e66-a722a1af444e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:18.727628 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3907640b-02ea-4878-8e66-a722a1af444e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:18.728731 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3907640b-02ea-4878-8e66-a722a1af444e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:18.924019 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3907640b-02ea-4878-8e66-a722a1af444e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:18.932289 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3907640b-02ea-4878-8e66-a722a1af444e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1318 microversion: 2.1 time: 0.227704 Aug 24 08:57:18.932955 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 147/304] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:18 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:19.280870 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-da3e8de3-7a66-4650-83e6-13d2b27412b1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:19.281774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-da3e8de3-7a66-4650-83e6-13d2b27412b1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:19.288603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-da3e8de3-7a66-4650-83e6-13d2b27412b1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.289449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-da3e8de3-7a66-4650-83e6-13d2b27412b1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.291211 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-da3e8de3-7a66-4650-83e6-13d2b27412b1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.292268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-da3e8de3-7a66-4650-83e6-13d2b27412b1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.292940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-da3e8de3-7a66-4650-83e6-13d2b27412b1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.293813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-da3e8de3-7a66-4650-83e6-13d2b27412b1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.486771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-da3e8de3-7a66-4650-83e6-13d2b27412b1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:19.486771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-da3e8de3-7a66-4650-83e6-13d2b27412b1 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1313 microversion: 2.1 time: 0.209713 Aug 24 08:57:19.486771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 158/305] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:19 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:19.640891 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5e5b0197-9ae2-48ea-bc56-eb0f705e7ae6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:19.642074 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5e5b0197-9ae2-48ea-bc56-eb0f705e7ae6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:19.654851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e5b0197-9ae2-48ea-bc56-eb0f705e7ae6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.655349 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e5b0197-9ae2-48ea-bc56-eb0f705e7ae6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.655929 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e5b0197-9ae2-48ea-bc56-eb0f705e7ae6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.657858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e5b0197-9ae2-48ea-bc56-eb0f705e7ae6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.658358 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e5b0197-9ae2-48ea-bc56-eb0f705e7ae6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.658797 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e5b0197-9ae2-48ea-bc56-eb0f705e7ae6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.955389 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6b0bfb9f-a002-4e93-95e3-e161b43ce6ec tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:19.956016 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6b0bfb9f-a002-4e93-95e3-e161b43ce6ec tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:19.962638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6b0bfb9f-a002-4e93-95e3-e161b43ce6ec tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.963390 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6b0bfb9f-a002-4e93-95e3-e161b43ce6ec tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.963860 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6b0bfb9f-a002-4e93-95e3-e161b43ce6ec tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.965526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6b0bfb9f-a002-4e93-95e3-e161b43ce6ec tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.965526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6b0bfb9f-a002-4e93-95e3-e161b43ce6ec tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.965732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6b0bfb9f-a002-4e93-95e3-e161b43ce6ec tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:20.009590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5e5b0197-9ae2-48ea-bc56-eb0f705e7ae6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:20.032478 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5e5b0197-9ae2-48ea-bc56-eb0f705e7ae6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.399892 Aug 24 08:57:20.034237 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 148/306] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:19 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:20.191910 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6b0bfb9f-a002-4e93-95e3-e161b43ce6ec tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:20.205202 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6b0bfb9f-a002-4e93-95e3-e161b43ce6ec tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1318 microversion: 2.1 time: 0.253809 Aug 24 08:57:20.205802 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 159/307] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:19 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:20.513671 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-256f8501-b108-4887-8abe-611d642dc42a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:20.515802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-256f8501-b108-4887-8abe-611d642dc42a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:20.531016 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-256f8501-b108-4887-8abe-611d642dc42a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:20.531639 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-256f8501-b108-4887-8abe-611d642dc42a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:20.532162 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-256f8501-b108-4887-8abe-611d642dc42a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:20.533096 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-256f8501-b108-4887-8abe-611d642dc42a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:20.533566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-256f8501-b108-4887-8abe-611d642dc42a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:20.534519 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-256f8501-b108-4887-8abe-611d642dc42a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:20.709927 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-256f8501-b108-4887-8abe-611d642dc42a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:20.716903 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-256f8501-b108-4887-8abe-611d642dc42a tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1313 microversion: 2.1 time: 0.208913 Aug 24 08:57:20.717491 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 149/308] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:20 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:21.056094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-01d9fc03-cddc-44ed-87ea-88fccebdd214 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:21.056888 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-01d9fc03-cddc-44ed-87ea-88fccebdd214 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:21.061104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:21.067044 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01d9fc03-cddc-44ed-87ea-88fccebdd214 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:21.071619 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01d9fc03-cddc-44ed-87ea-88fccebdd214 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:21.072177 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01d9fc03-cddc-44ed-87ea-88fccebdd214 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:21.072962 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01d9fc03-cddc-44ed-87ea-88fccebdd214 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:21.073428 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01d9fc03-cddc-44ed-87ea-88fccebdd214 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:21.073879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01d9fc03-cddc-44ed-87ea-88fccebdd214 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:21.232448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7e295ad5-f0df-48c7-8928-4978cf7ba0e9 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:21.233263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-7e295ad5-f0df-48c7-8928-4978cf7ba0e9 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:21.242165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7e295ad5-f0df-48c7-8928-4978cf7ba0e9 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:21.242671 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7e295ad5-f0df-48c7-8928-4978cf7ba0e9 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:21.243155 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7e295ad5-f0df-48c7-8928-4978cf7ba0e9 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:21.243892 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7e295ad5-f0df-48c7-8928-4978cf7ba0e9 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:21.244571 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7e295ad5-f0df-48c7-8928-4978cf7ba0e9 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:21.245034 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7e295ad5-f0df-48c7-8928-4978cf7ba0e9 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:21.274156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-01d9fc03-cddc-44ed-87ea-88fccebdd214 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:21.286066 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-01d9fc03-cddc-44ed-87ea-88fccebdd214 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.233879 Aug 24 08:57:21.286799 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 160/309] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:21 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:21.514331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7e295ad5-f0df-48c7-8928-4978cf7ba0e9 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:21.523246 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7e295ad5-f0df-48c7-8928-4978cf7ba0e9 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1318 microversion: 2.1 time: 0.296206 Aug 24 08:57:21.523816 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 150/310] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:21 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:21.740890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-377325eb-0c6c-4efb-96f0-1f3483c292cf tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:21.741733 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-377325eb-0c6c-4efb-96f0-1f3483c292cf tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:21.753265 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-377325eb-0c6c-4efb-96f0-1f3483c292cf tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:21.753998 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-377325eb-0c6c-4efb-96f0-1f3483c292cf tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:21.754819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-377325eb-0c6c-4efb-96f0-1f3483c292cf tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:21.755669 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-377325eb-0c6c-4efb-96f0-1f3483c292cf tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:21.756242 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-377325eb-0c6c-4efb-96f0-1f3483c292cf tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:21.756813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-377325eb-0c6c-4efb-96f0-1f3483c292cf tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:22.226805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-377325eb-0c6c-4efb-96f0-1f3483c292cf tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:22.240108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-377325eb-0c6c-4efb-96f0-1f3483c292cf tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1497 microversion: 2.1 time: 0.504985 Aug 24 08:57:22.242718 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 161/311] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:21 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1497 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:22.318029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9dd21a7b-0063-46e5-b400-45660e980451 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:22.318634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9dd21a7b-0063-46e5-b400-45660e980451 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:22.326103 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9dd21a7b-0063-46e5-b400-45660e980451 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:22.326861 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9dd21a7b-0063-46e5-b400-45660e980451 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:22.327017 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9dd21a7b-0063-46e5-b400-45660e980451 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:22.327637 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9dd21a7b-0063-46e5-b400-45660e980451 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:22.328268 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9dd21a7b-0063-46e5-b400-45660e980451 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:22.328779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9dd21a7b-0063-46e5-b400-45660e980451 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:22.482975 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-5e3d8f4d-2689-46eb-a293-f5231f861d7f req-7d2293e7-7cff-4ee6-a1cd-44642bc162ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e11c5e20-10df-4e90-9cbe-7ca8cdf061d7", "name": "network-vif-plugged", "status": "completed", "tag": "32104588-8907-4ad0-b7dd-d6cd37053597"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:22.487906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9dd21a7b-0063-46e5-b400-45660e980451 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:22.497506 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-5e3d8f4d-2689-46eb-a293-f5231f861d7f req-7d2293e7-7cff-4ee6-a1cd-44642bc162ea service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:22.498051 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9dd21a7b-0063-46e5-b400-45660e980451 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.184602 Aug 24 08:57:22.498817 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-5e3d8f4d-2689-46eb-a293-f5231f861d7f req-7d2293e7-7cff-4ee6-a1cd-44642bc162ea service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:22.499578 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-5e3d8f4d-2689-46eb-a293-f5231f861d7f req-7d2293e7-7cff-4ee6-a1cd-44642bc162ea service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:22.505174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 151/312] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:22 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:22.515178 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-5e3d8f4d-2689-46eb-a293-f5231f861d7f req-7d2293e7-7cff-4ee6-a1cd-44642bc162ea service nova] Creating event network-vif-plugged:32104588-8907-4ad0-b7dd-d6cd37053597 for instance e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 on hv-cinder-85221 Aug 24 08:57:22.522943 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-5e3d8f4d-2689-46eb-a293-f5231f861d7f req-7d2293e7-7cff-4ee6-a1cd-44642bc162ea service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045565 Aug 24 08:57:22.523749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 162/313] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:57:22.545994 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-10c7d1f5-1492-4e30-9811-d109f1c8be37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:22.547858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-10c7d1f5-1492-4e30-9811-d109f1c8be37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:22.558000 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-10c7d1f5-1492-4e30-9811-d109f1c8be37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:22.558504 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-10c7d1f5-1492-4e30-9811-d109f1c8be37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:22.559034 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-10c7d1f5-1492-4e30-9811-d109f1c8be37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:22.559752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-10c7d1f5-1492-4e30-9811-d109f1c8be37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:22.560252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-10c7d1f5-1492-4e30-9811-d109f1c8be37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:22.560755 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-10c7d1f5-1492-4e30-9811-d109f1c8be37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:22.823579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-10c7d1f5-1492-4e30-9811-d109f1c8be37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:22.859136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-10c7d1f5-1492-4e30-9811-d109f1c8be37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1318 microversion: 2.1 time: 0.317434 Aug 24 08:57:22.866125 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 152/314] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:22 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:23.526525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-305c8427-c3b0-49e3-86bd-85b39ba4806d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:23.528734 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-305c8427-c3b0-49e3-86bd-85b39ba4806d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:23.534886 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b939d35c-dcac-40fe-9438-cfa730432f9d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:23.535723 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b939d35c-dcac-40fe-9438-cfa730432f9d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:23.547616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-305c8427-c3b0-49e3-86bd-85b39ba4806d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.552071 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-305c8427-c3b0-49e3-86bd-85b39ba4806d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.552071 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-305c8427-c3b0-49e3-86bd-85b39ba4806d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.552071 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-305c8427-c3b0-49e3-86bd-85b39ba4806d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.553196 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-305c8427-c3b0-49e3-86bd-85b39ba4806d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.553948 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-305c8427-c3b0-49e3-86bd-85b39ba4806d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.561507 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b939d35c-dcac-40fe-9438-cfa730432f9d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.562418 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b939d35c-dcac-40fe-9438-cfa730432f9d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.563966 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b939d35c-dcac-40fe-9438-cfa730432f9d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.565378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b939d35c-dcac-40fe-9438-cfa730432f9d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.566222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b939d35c-dcac-40fe-9438-cfa730432f9d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.567164 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b939d35c-dcac-40fe-9438-cfa730432f9d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.618465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b939d35c-dcac-40fe-9438-cfa730432f9d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Going to try to terminate instance {{(pid=132985) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:57:23.790823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-305c8427-c3b0-49e3-86bd-85b39ba4806d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:23.794762 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-305c8427-c3b0-49e3-86bd-85b39ba4806d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.277747 Aug 24 08:57:23.795358 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 163/315] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:23 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:23.885589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7787d298-de16-4d41-9676-bf6bec2dbc94 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:23.886207 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7787d298-de16-4d41-9676-bf6bec2dbc94 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:23.892601 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7787d298-de16-4d41-9676-bf6bec2dbc94 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.893113 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7787d298-de16-4d41-9676-bf6bec2dbc94 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.893524 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7787d298-de16-4d41-9676-bf6bec2dbc94 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.894728 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7787d298-de16-4d41-9676-bf6bec2dbc94 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.895370 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7787d298-de16-4d41-9676-bf6bec2dbc94 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.895796 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7787d298-de16-4d41-9676-bf6bec2dbc94 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.982130 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:24.061937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7787d298-de16-4d41-9676-bf6bec2dbc94 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:24.070823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7787d298-de16-4d41-9676-bf6bec2dbc94 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1318 microversion: 2.1 time: 0.189013 Aug 24 08:57:24.071730 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 164/316] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:23 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:24.180728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b939d35c-dcac-40fe-9438-cfa730432f9d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 204 len: 0 microversion: 2.1 time: 0.654890 Aug 24 08:57:24.181747 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 153/317] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 08:57:23 2022] DELETE /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:57:24.191748 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3342efd7-d2a0-43c2-bddd-60e652f3e99d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:24.192406 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3342efd7-d2a0-43c2-bddd-60e652f3e99d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:24.201201 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3342efd7-d2a0-43c2-bddd-60e652f3e99d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:24.201890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3342efd7-d2a0-43c2-bddd-60e652f3e99d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:24.202452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3342efd7-d2a0-43c2-bddd-60e652f3e99d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:24.203383 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3342efd7-d2a0-43c2-bddd-60e652f3e99d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:24.204080 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3342efd7-d2a0-43c2-bddd-60e652f3e99d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:24.205188 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3342efd7-d2a0-43c2-bddd-60e652f3e99d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:24.379170 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3342efd7-d2a0-43c2-bddd-60e652f3e99d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:24.387580 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3342efd7-d2a0-43c2-bddd-60e652f3e99d tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1503 microversion: 2.1 time: 0.199997 Aug 24 08:57:24.388168 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 165/318] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:24 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:24.817661 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c0ad8ac9-dfb4-4203-9c83-95be45010ad2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:24.818810 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c0ad8ac9-dfb4-4203-9c83-95be45010ad2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:24.826590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c0ad8ac9-dfb4-4203-9c83-95be45010ad2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:24.827097 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c0ad8ac9-dfb4-4203-9c83-95be45010ad2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:24.827530 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c0ad8ac9-dfb4-4203-9c83-95be45010ad2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:24.828244 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c0ad8ac9-dfb4-4203-9c83-95be45010ad2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:24.828795 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c0ad8ac9-dfb4-4203-9c83-95be45010ad2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:24.829335 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c0ad8ac9-dfb4-4203-9c83-95be45010ad2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:24.980528 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c0ad8ac9-dfb4-4203-9c83-95be45010ad2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:24.984278 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:24.989376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c0ad8ac9-dfb4-4203-9c83-95be45010ad2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.176465 Aug 24 08:57:24.990163 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 154/319] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:24 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:25.097296 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-876b2ffa-ce3d-45fe-bfff-98a1b05bc9de tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:25.098359 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-876b2ffa-ce3d-45fe-bfff-98a1b05bc9de tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:25.107847 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-876b2ffa-ce3d-45fe-bfff-98a1b05bc9de tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:25.108454 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-876b2ffa-ce3d-45fe-bfff-98a1b05bc9de tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:25.109044 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-876b2ffa-ce3d-45fe-bfff-98a1b05bc9de tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:25.109909 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-876b2ffa-ce3d-45fe-bfff-98a1b05bc9de tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:25.110593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-876b2ffa-ce3d-45fe-bfff-98a1b05bc9de tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:25.111118 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-876b2ffa-ce3d-45fe-bfff-98a1b05bc9de tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:25.298122 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-876b2ffa-ce3d-45fe-bfff-98a1b05bc9de tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:25.306838 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-876b2ffa-ce3d-45fe-bfff-98a1b05bc9de tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1318 microversion: 2.1 time: 0.216429 Aug 24 08:57:25.307758 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 166/320] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:25 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:25.411130 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9019a62b-d7f3-4cbb-bd4f-5171863c7fec tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:25.411760 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9019a62b-d7f3-4cbb-bd4f-5171863c7fec tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:25.420252 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9019a62b-d7f3-4cbb-bd4f-5171863c7fec tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:25.420786 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9019a62b-d7f3-4cbb-bd4f-5171863c7fec tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:25.421217 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9019a62b-d7f3-4cbb-bd4f-5171863c7fec tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:25.421924 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9019a62b-d7f3-4cbb-bd4f-5171863c7fec tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:25.422538 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9019a62b-d7f3-4cbb-bd4f-5171863c7fec tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:25.422866 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9019a62b-d7f3-4cbb-bd4f-5171863c7fec tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:25.483381 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-59fbc18d-e0c3-4da0-bb6b-da6a6e6a88e5 tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] Action: 'create', calling method: .version_select at 0x7f16ae7d5160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-975620959", "metadata": {"Type": "work"}}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:25.598994 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9019a62b-d7f3-4cbb-bd4f-5171863c7fec tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:25.606817 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9019a62b-d7f3-4cbb-bd4f-5171863c7fec tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1503 microversion: 2.1 time: 0.199898 Aug 24 08:57:25.607411 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 167/321] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:25 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:26.015203 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-36e58413-0c9d-43af-b090-2bb0f62ce7ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:26.018376 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-36e58413-0c9d-43af-b090-2bb0f62ce7ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:26.022379 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-36e58413-0c9d-43af-b090-2bb0f62ce7ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:26.023154 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-36e58413-0c9d-43af-b090-2bb0f62ce7ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:26.023381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-36e58413-0c9d-43af-b090-2bb0f62ce7ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:26.023959 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-36e58413-0c9d-43af-b090-2bb0f62ce7ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:26.024410 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-36e58413-0c9d-43af-b090-2bb0f62ce7ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:26.024848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-36e58413-0c9d-43af-b090-2bb0f62ce7ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:26.174372 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-36e58413-0c9d-43af-b090-2bb0f62ce7ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:26.187541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-36e58413-0c9d-43af-b090-2bb0f62ce7ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.176083 Aug 24 08:57:26.188698 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 168/322] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:26 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:26.275362 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-59fbc18d-e0c3-4da0-bb6b-da6a6e6a88e5 tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.937682 Aug 24 08:57:26.276492 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 155/323] 10.222.0.55 () {60 vars in 1156 bytes} [Wed Aug 24 08:57:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 940 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 08:57:26.289070 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b5b1581a-edd1-46a3-9113-2587a5e9faa6 tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] Calling method '.version_select at 0x7f16ae63d160>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:26.329090 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-254a6461-6f7d-4368-a2ee-311ad2bd2461 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:26.329842 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-254a6461-6f7d-4368-a2ee-311ad2bd2461 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:26.340788 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-254a6461-6f7d-4368-a2ee-311ad2bd2461 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:26.341588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-254a6461-6f7d-4368-a2ee-311ad2bd2461 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:26.342269 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-254a6461-6f7d-4368-a2ee-311ad2bd2461 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:26.343474 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-254a6461-6f7d-4368-a2ee-311ad2bd2461 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:26.344209 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-254a6461-6f7d-4368-a2ee-311ad2bd2461 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:26.344874 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b5b1581a-edd1-46a3-9113-2587a5e9faa6 tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de" status: 200 len: 352 microversion: 2.1 time: 0.059334 Aug 24 08:57:26.345009 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-254a6461-6f7d-4368-a2ee-311ad2bd2461 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:26.345806 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 169/324] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 08:57:26 2022] GET /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:26.495705 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-254a6461-6f7d-4368-a2ee-311ad2bd2461 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:26.503750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-254a6461-6f7d-4368-a2ee-311ad2bd2461 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1318 microversion: 2.1 time: 0.178762 Aug 24 08:57:26.504328 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 156/325] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:26 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:26.627799 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fbbd5001-8e64-4a31-bc49-0e4fc170f390 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:26.628316 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fbbd5001-8e64-4a31-bc49-0e4fc170f390 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:26.634719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbbd5001-8e64-4a31-bc49-0e4fc170f390 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:26.635206 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbbd5001-8e64-4a31-bc49-0e4fc170f390 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:26.635645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbbd5001-8e64-4a31-bc49-0e4fc170f390 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:26.636335 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbbd5001-8e64-4a31-bc49-0e4fc170f390 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:26.636804 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbbd5001-8e64-4a31-bc49-0e4fc170f390 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:26.637229 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbbd5001-8e64-4a31-bc49-0e4fc170f390 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:26.811493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fbbd5001-8e64-4a31-bc49-0e4fc170f390 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:26.815181 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:26.819921 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fbbd5001-8e64-4a31-bc49-0e4fc170f390 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1503 microversion: 2.1 time: 0.196348 Aug 24 08:57:26.820501 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 170/326] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:26 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:27.222998 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0b77b7d8-6ba4-43f9-bd47-0c408daa6a1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:27.223618 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0b77b7d8-6ba4-43f9-bd47-0c408daa6a1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:27.230475 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0b77b7d8-6ba4-43f9-bd47-0c408daa6a1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:27.230960 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0b77b7d8-6ba4-43f9-bd47-0c408daa6a1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:27.231398 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0b77b7d8-6ba4-43f9-bd47-0c408daa6a1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:27.232109 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0b77b7d8-6ba4-43f9-bd47-0c408daa6a1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:27.232642 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0b77b7d8-6ba4-43f9-bd47-0c408daa6a1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:27.233021 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0b77b7d8-6ba4-43f9-bd47-0c408daa6a1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:27.360196 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-78bd1cc2-8761-4b03-b1a0-8f59a31a26f1 tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] Calling method '.version_select at 0x7f16ae7598b0>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:27.417642 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-78bd1cc2-8761-4b03-b1a0-8f59a31a26f1 tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de" status: 200 len: 352 microversion: 2.1 time: 0.061725 Aug 24 08:57:27.418327 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 171/327] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 08:57:27 2022] GET /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:57:27.527639 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-93121c76-9194-417f-92d7-82a20bd9548f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:27.528271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-93121c76-9194-417f-92d7-82a20bd9548f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:27.539880 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-93121c76-9194-417f-92d7-82a20bd9548f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:27.540768 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-93121c76-9194-417f-92d7-82a20bd9548f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:27.541224 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-93121c76-9194-417f-92d7-82a20bd9548f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:27.542183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-93121c76-9194-417f-92d7-82a20bd9548f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:27.542748 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-93121c76-9194-417f-92d7-82a20bd9548f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:27.543372 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-93121c76-9194-417f-92d7-82a20bd9548f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:27.671158 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0b77b7d8-6ba4-43f9-bd47-0c408daa6a1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:27.680360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0b77b7d8-6ba4-43f9-bd47-0c408daa6a1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.461731 Aug 24 08:57:27.681159 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 157/328] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:27 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:27.736460 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-93121c76-9194-417f-92d7-82a20bd9548f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:27.745097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-93121c76-9194-417f-92d7-82a20bd9548f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1508 microversion: 2.1 time: 0.222092 Aug 24 08:57:27.745709 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 172/329] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:27 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:27.841877 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a1ecffa2-8a32-4532-9b37-13de779f432e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:27.842656 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a1ecffa2-8a32-4532-9b37-13de779f432e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:27.850328 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1ecffa2-8a32-4532-9b37-13de779f432e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:27.850818 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1ecffa2-8a32-4532-9b37-13de779f432e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:27.851248 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1ecffa2-8a32-4532-9b37-13de779f432e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:27.851980 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1ecffa2-8a32-4532-9b37-13de779f432e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:27.852427 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1ecffa2-8a32-4532-9b37-13de779f432e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:27.852874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1ecffa2-8a32-4532-9b37-13de779f432e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:28.068103 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a1ecffa2-8a32-4532-9b37-13de779f432e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:28.083681 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a1ecffa2-8a32-4532-9b37-13de779f432e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1503 microversion: 2.1 time: 0.245420 Aug 24 08:57:28.084931 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 158/330] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:27 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1503 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:28.432587 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a41f5c58-f6f7-4bf0-bf4f-9c383fc9075a tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] Calling method '.version_select at 0x7f16ae79c5e0>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:28.505971 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a41f5c58-f6f7-4bf0-bf4f-9c383fc9075a tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de" status: 200 len: 353 microversion: 2.1 time: 0.077889 Aug 24 08:57:28.506573 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 173/331] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 08:57:28 2022] GET /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:28.520239 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c2ade07b-0af5-454d-b2e5-5893fef42f1a tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] Calling method '.version_select at 0x7f16b08a9b80>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:28.577628 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c2ade07b-0af5-454d-b2e5-5893fef42f1a tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de" status: 200 len: 353 microversion: 2.1 time: 0.061552 Aug 24 08:57:28.578124 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 159/332] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 08:57:28 2022] GET /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:28.597487 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5c6f724c-52f7-4c6b-b2d7-f42e1dad797b tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] Calling method '.version_select at 0x7f16ae71a310>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:28.714485 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-36ba8f05-e91c-4655-b0bc-55856316f063 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:28.715195 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-36ba8f05-e91c-4655-b0bc-55856316f063 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:28.725425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36ba8f05-e91c-4655-b0bc-55856316f063 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:28.725951 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36ba8f05-e91c-4655-b0bc-55856316f063 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:28.727482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36ba8f05-e91c-4655-b0bc-55856316f063 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:28.727482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36ba8f05-e91c-4655-b0bc-55856316f063 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:28.727775 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36ba8f05-e91c-4655-b0bc-55856316f063 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:28.728171 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36ba8f05-e91c-4655-b0bc-55856316f063 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:28.900706 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5c6f724c-52f7-4c6b-b2d7-f42e1dad797b tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de" status: 202 len: 0 microversion: 2.1 time: 0.307559 Aug 24 08:57:28.901410 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 174/333] 10.222.0.55 () {58 vars in 1248 bytes} [Wed Aug 24 08:57:28 2022] DELETE /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:57:28.910980 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-4de49029-58fc-4f3c-bbd6-c0cde537f330 req-a3632b60-1527-40d5-8950-53e65efaed9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a832696d-f49f-42ae-88b9-339966f7523a", "name": "network-vif-deleted", "tag": "c077090b-d32a-44fa-a33b-c34bce6cba0e"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:28.926127 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-4de49029-58fc-4f3c-bbd6-c0cde537f330 req-a3632b60-1527-40d5-8950-53e65efaed9b service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:28.926687 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-4de49029-58fc-4f3c-bbd6-c0cde537f330 req-a3632b60-1527-40d5-8950-53e65efaed9b service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:28.930552 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-4de49029-58fc-4f3c-bbd6-c0cde537f330 req-a3632b60-1527-40d5-8950-53e65efaed9b service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:28.940061 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-4de49029-58fc-4f3c-bbd6-c0cde537f330 req-a3632b60-1527-40d5-8950-53e65efaed9b service nova] Creating event network-vif-deleted:c077090b-d32a-44fa-a33b-c34bce6cba0e for instance a832696d-f49f-42ae-88b9-339966f7523a on hv-cinder-85221 Aug 24 08:57:28.946586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-4de49029-58fc-4f3c-bbd6-c0cde537f330 req-a3632b60-1527-40d5-8950-53e65efaed9b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040090 Aug 24 08:57:28.947209 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 175/334] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:28.953029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1b2990a6-8139-44da-a7a1-1ddec8ad556f tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] Calling method '.version_select at 0x7f16b01dd1f0>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:28.954834 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-36ba8f05-e91c-4655-b0bc-55856316f063 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:28.964893 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-36ba8f05-e91c-4655-b0bc-55856316f063 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.254879 Aug 24 08:57:28.965500 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 160/335] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:28 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:29.005299 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1b2990a6-8139-44da-a7a1-1ddec8ad556f tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de" status: 200 len: 352 microversion: 2.1 time: 0.056859 Aug 24 08:57:29.006280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 176/336] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 08:57:28 2022] GET /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:29.108693 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0de66572-1aca-443d-a8e2-2e1aa58d4937 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:29.109306 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0de66572-1aca-443d-a8e2-2e1aa58d4937 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:29.116128 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0de66572-1aca-443d-a8e2-2e1aa58d4937 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:29.116893 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0de66572-1aca-443d-a8e2-2e1aa58d4937 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:29.118371 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0de66572-1aca-443d-a8e2-2e1aa58d4937 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:29.118371 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0de66572-1aca-443d-a8e2-2e1aa58d4937 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:29.118371 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0de66572-1aca-443d-a8e2-2e1aa58d4937 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:29.118803 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0de66572-1aca-443d-a8e2-2e1aa58d4937 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:29.188269 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0de66572-1aca-443d-a8e2-2e1aa58d4937 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:29.197078 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0de66572-1aca-443d-a8e2-2e1aa58d4937 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 200 len: 1298 microversion: 2.1 time: 0.092103 Aug 24 08:57:29.197649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 161/337] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:29 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:29.993870 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d37927d7-4186-4c22-a9ef-54c0ea63ffaa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:29.995652 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d37927d7-4186-4c22-a9ef-54c0ea63ffaa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:30.002302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d37927d7-4186-4c22-a9ef-54c0ea63ffaa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:30.002853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d37927d7-4186-4c22-a9ef-54c0ea63ffaa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:30.003758 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d37927d7-4186-4c22-a9ef-54c0ea63ffaa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:30.004493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d37927d7-4186-4c22-a9ef-54c0ea63ffaa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:30.005118 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d37927d7-4186-4c22-a9ef-54c0ea63ffaa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:30.005546 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d37927d7-4186-4c22-a9ef-54c0ea63ffaa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:30.024982 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cf7bb4be-400b-411b-9146-1de0318a115d tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] Calling method '.version_select at 0x7f16ae7d5ee0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:30.069122 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-cf7bb4be-400b-411b-9146-1de0318a115d tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] HTTP exception thrown: Volume b75da1a9-4452-41bb-b8ed-0733cc1279de could not be found. Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cf7bb4be-400b-411b-9146-1de0318a115d tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] Request method failure captured: Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de HTTP/1.1 Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBef1SrdtmonZHJNcNuQAI98ODmWJQh2qfGl465SBloSVV5WzdNjM7X6PuToNEMIlZqDB4Zf4zCEqKaZ9iybyofBeSOKS7ZvzFUj2T94D-F_Om40oPd620tlI-B7xNwJVwkNNDvVtYc9G1N5WTo4t7tyE8LQfh4k3OTzaDk66kfCBhyw Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: af77427688444a6389044f863be8130d Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-VolumesGetTestJSON-671215718 Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 08:57:30.071347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 08:57:30.074146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/af77427688444a6389044f863be8130d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_af77427688444a6389044f863be8130d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af77427688444a6389044f863be8130d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af77427688444a6389044f863be8130d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:57:30.074146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-VolumesGetTestJSON-671215718 Aug 24 08:57:30.074146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: af77427688444a6389044f863be8130d Aug 24 08:57:30.074146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-VolumesGetTestJSON-671215718 Aug 24 08:57:30.074146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-VolumesGetTestJSON-671215718-project Aug 24 08:57:30.074146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 08:57:30.074146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 08:57:30.074146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: e79d556cfe1e4260a34ad8fadb08e27e Aug 24 08:57:30.074146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-VolumesGetTestJSON-671215718-project Aug 24 08:57:30.074146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: Aug 24 08:57:30.074146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Volume b75da1a9-4452-41bb-b8ed-0733cc1279de could not be found. Aug 24 08:57:30.074146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': 'b75da1a9-4452-41bb-b8ed-0733cc1279de'} Aug 24 08:57:30.074146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b75da1a9-4452-41bb-b8ed-0733cc1279de could not be found. (HTTP 404) (Request-ID: req-6d8d1a8c-750a-44cb-8b0b-596deb05fcb5) Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:30.075752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:57:30.077743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b75da1a9-4452-41bb-b8ed-0733cc1279de could not be found. Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 08:57:30.079256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b75da1a9-4452-41bb-b8ed-0733cc1279de could not be found. Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b75da1a9-4452-41bb-b8ed-0733cc1279de could not be found. Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cf7bb4be-400b-411b-9146-1de0318a115d tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] Returning 404 to user: Volume b75da1a9-4452-41bb-b8ed-0733cc1279de could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-cf7bb4be-400b-411b-9146-1de0318a115d tempest-VolumesGetTestJSON-671215718 tempest-VolumesGetTestJSON-671215718-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de" status: 404 len: 109 microversion: 2.1 time: 0.052776 Aug 24 08:57:30.081529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 162/338] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 08:57:30 2022] GET /compute/v2.1/os-volumes/b75da1a9-4452-41bb-b8ed-0733cc1279de => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:57:30.194454 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d37927d7-4186-4c22-a9ef-54c0ea63ffaa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:30.204403 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d37927d7-4186-4c22-a9ef-54c0ea63ffaa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.218853 Aug 24 08:57:30.208668 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 177/339] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:29 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:30.227605 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-046e3a8f-4744-4f67-a9ee-1a7a8341799c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:30.228826 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-046e3a8f-4744-4f67-a9ee-1a7a8341799c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: a832696d-f49f-42ae-88b9-339966f7523a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:30.236355 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-046e3a8f-4744-4f67-a9ee-1a7a8341799c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:30.243161 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-046e3a8f-4744-4f67-a9ee-1a7a8341799c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:30.243732 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-046e3a8f-4744-4f67-a9ee-1a7a8341799c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:30.244527 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-046e3a8f-4744-4f67-a9ee-1a7a8341799c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:30.245032 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-046e3a8f-4744-4f67-a9ee-1a7a8341799c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:30.245459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-046e3a8f-4744-4f67-a9ee-1a7a8341799c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:30.259986 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-046e3a8f-4744-4f67-a9ee-1a7a8341799c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] HTTP exception thrown: Instance a832696d-f49f-42ae-88b9-339966f7523a could not be found. Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-046e3a8f-4744-4f67-a9ee-1a7a8341799c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Request method failure captured: Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a HTTP/1.1 Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBefS5XUE0k9pW5va4tqAsMRVFhlF8xRVaDsTlv9rwv-l0UXoU5VSM118bDrFy1ohikE-ciAvA_22QGoa49auni2HnVlLkZMP18HWJL11aWBtCkj789jg3mFo5-fALQghoW1zt8J2EH0YjkDYcQNLbTzj8eC40_H4NoMAIvXSYivlorE Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: f9753d09aeea45378d637bf28536bb7d Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-VolumesActionsTest-844008822 Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 08:57:30.261634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 08:57:30.264181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f9753d09aeea45378d637bf28536bb7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f9753d09aeea45378d637bf28536bb7d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f9753d09aeea45378d637bf28536bb7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f9753d09aeea45378d637bf28536bb7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:57:30.264181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-VolumesActionsTest-844008822 Aug 24 08:57:30.264181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: f9753d09aeea45378d637bf28536bb7d Aug 24 08:57:30.264181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-VolumesActionsTest-844008822 Aug 24 08:57:30.264181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-VolumesActionsTest-844008822-project Aug 24 08:57:30.264181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 08:57:30.264181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 08:57:30.264181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: bb815fa9f45a4b1db1f30fbfaeb3c4c9 Aug 24 08:57:30.264181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-VolumesActionsTest-844008822-project Aug 24 08:57:30.264181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 08:57:30.264181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance a832696d-f49f-42ae-88b9-339966f7523a could not be found. Aug 24 08:57:30.264181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': 'a832696d-f49f-42ae-88b9-339966f7523a'} Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a832696d-f49f-42ae-88b9-339966f7523a could not be found. Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:57:30.265129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a832696d-f49f-42ae-88b9-339966f7523a could not be found. Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a832696d-f49f-42ae-88b9-339966f7523a could not be found. Aug 24 08:57:30.266314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 08:57:30.267400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-046e3a8f-4744-4f67-a9ee-1a7a8341799c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Returning 404 to user: Instance a832696d-f49f-42ae-88b9-339966f7523a could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:57:30.267400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-046e3a8f-4744-4f67-a9ee-1a7a8341799c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a" status: 404 len: 111 microversion: 2.1 time: 0.039605 Aug 24 08:57:30.267400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 163/340] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:30 2022] GET /compute/v2.1/servers/a832696d-f49f-42ae-88b9-339966f7523a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:57:30.375345 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-312122332", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "networks": [{"uuid": "eb54e597-68c7-4db7-beca-c672bbf2ac24"}]}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:31.236909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-788d10e5-3553-4102-a293-456f1b3109a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:31.240200 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-788d10e5-3553-4102-a293-456f1b3109a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:31.247318 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-788d10e5-3553-4102-a293-456f1b3109a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:31.248211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-788d10e5-3553-4102-a293-456f1b3109a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:31.248932 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-788d10e5-3553-4102-a293-456f1b3109a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:31.250000 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-788d10e5-3553-4102-a293-456f1b3109a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:31.250695 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-788d10e5-3553-4102-a293-456f1b3109a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:31.251419 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-788d10e5-3553-4102-a293-456f1b3109a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:31.424318 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-788d10e5-3553-4102-a293-456f1b3109a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:31.440686 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-788d10e5-3553-4102-a293-456f1b3109a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.208546 Aug 24 08:57:31.441743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 164/341] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:31 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:32.479607 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2e7c5465-9773-4bfb-a45e-f6e52be46b6f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:32.480353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2e7c5465-9773-4bfb-a45e-f6e52be46b6f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:32.488142 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2e7c5465-9773-4bfb-a45e-f6e52be46b6f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:32.488771 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2e7c5465-9773-4bfb-a45e-f6e52be46b6f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:32.489298 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2e7c5465-9773-4bfb-a45e-f6e52be46b6f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:32.490078 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2e7c5465-9773-4bfb-a45e-f6e52be46b6f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:32.490527 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2e7c5465-9773-4bfb-a45e-f6e52be46b6f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:32.490944 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2e7c5465-9773-4bfb-a45e-f6e52be46b6f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:32.649270 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2e7c5465-9773-4bfb-a45e-f6e52be46b6f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:32.657506 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2e7c5465-9773-4bfb-a45e-f6e52be46b6f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.185831 Aug 24 08:57:32.658129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 165/342] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:32 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:33.684088 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e873ee3a-1670-4648-b5e9-6ac9d2c127c6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:33.686384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e873ee3a-1670-4648-b5e9-6ac9d2c127c6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:33.697721 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e873ee3a-1670-4648-b5e9-6ac9d2c127c6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:33.698558 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e873ee3a-1670-4648-b5e9-6ac9d2c127c6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:33.699343 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e873ee3a-1670-4648-b5e9-6ac9d2c127c6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:33.700826 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e873ee3a-1670-4648-b5e9-6ac9d2c127c6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:33.702072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e873ee3a-1670-4648-b5e9-6ac9d2c127c6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:33.703033 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e873ee3a-1670-4648-b5e9-6ac9d2c127c6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:33.947543 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e873ee3a-1670-4648-b5e9-6ac9d2c127c6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:33.955435 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e873ee3a-1670-4648-b5e9-6ac9d2c127c6 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.278835 Aug 24 08:57:33.956077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 166/343] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:33 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:34.981774 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-924d9d1e-39cb-49f3-81a1-8c74deb9dc30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:34.984414 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-924d9d1e-39cb-49f3-81a1-8c74deb9dc30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:34.995668 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-924d9d1e-39cb-49f3-81a1-8c74deb9dc30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:34.996588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-924d9d1e-39cb-49f3-81a1-8c74deb9dc30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:34.997373 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-924d9d1e-39cb-49f3-81a1-8c74deb9dc30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:34.998863 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-924d9d1e-39cb-49f3-81a1-8c74deb9dc30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:34.999490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-924d9d1e-39cb-49f3-81a1-8c74deb9dc30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:35.000249 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-924d9d1e-39cb-49f3-81a1-8c74deb9dc30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:35.185062 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-924d9d1e-39cb-49f3-81a1-8c74deb9dc30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:35.220219 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-924d9d1e-39cb-49f3-81a1-8c74deb9dc30 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.245685 Aug 24 08:57:35.223148 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 167/344] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:34 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:36.029878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.network.neutron [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] validate_networks() for [('eb54e597-68c7-4db7-beca-c672bbf2ac24', None, None, None, None, None)] {{(pid=132984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:57:36.269508 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ac84c9d5-c387-45bf-86f1-ffbd541fa056 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:36.274792 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ac84c9d5-c387-45bf-86f1-ffbd541fa056 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:36.304682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac84c9d5-c387-45bf-86f1-ffbd541fa056 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:36.306163 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac84c9d5-c387-45bf-86f1-ffbd541fa056 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:36.306985 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac84c9d5-c387-45bf-86f1-ffbd541fa056 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:36.309088 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac84c9d5-c387-45bf-86f1-ffbd541fa056 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:36.309883 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac84c9d5-c387-45bf-86f1-ffbd541fa056 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:36.310543 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac84c9d5-c387-45bf-86f1-ffbd541fa056 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:36.499813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Flavor limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:57:36.500429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Image limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:57:36.501049 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Flavor pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:57:36.501822 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Image pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:57:36.502316 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:57:36.516849 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:36.517817 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:36.518602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:36.519952 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:36.520738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:36.521472 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:36.552082 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Getting quotas for project f9753d09aeea45378d637bf28536bb7d. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:57:36.560197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Getting quotas for user bb815fa9f45a4b1db1f30fbfaeb3c4c9 and project f9753d09aeea45378d637bf28536bb7d. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:57:36.568669 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ac84c9d5-c387-45bf-86f1-ffbd541fa056 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:36.581254 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Going to run 1 instances... {{(pid=132984) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:57:36.581489 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ac84c9d5-c387-45bf-86f1-ffbd541fa056 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.329717 Aug 24 08:57:36.582362 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 168/345] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:36 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:36.584073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:57:36.753639 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-88382302-4655-48d8-8d84-0098fa5754df tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.381608 Aug 24 08:57:36.754734 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 178/346] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 08:57:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 6384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:57:36.769838 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-933b5c5e-388b-4974-9032-4d7b01ae3452 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:36.770983 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-933b5c5e-388b-4974-9032-4d7b01ae3452 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:36.866908 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-933b5c5e-388b-4974-9032-4d7b01ae3452 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:36.874056 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-933b5c5e-388b-4974-9032-4d7b01ae3452 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1213 microversion: 2.1 time: 0.110174 Aug 24 08:57:36.874873 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 169/347] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:36 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:37.604842 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-736c4718-cbcb-4bdd-9649-12ccdf5fffec tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:37.605802 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-736c4718-cbcb-4bdd-9649-12ccdf5fffec tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:37.613496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-736c4718-cbcb-4bdd-9649-12ccdf5fffec tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:37.614007 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-736c4718-cbcb-4bdd-9649-12ccdf5fffec tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:37.616381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-736c4718-cbcb-4bdd-9649-12ccdf5fffec tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:37.616381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-736c4718-cbcb-4bdd-9649-12ccdf5fffec tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:37.616381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-736c4718-cbcb-4bdd-9649-12ccdf5fffec tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:37.616381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-736c4718-cbcb-4bdd-9649-12ccdf5fffec tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:37.856453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-736c4718-cbcb-4bdd-9649-12ccdf5fffec tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:37.873779 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-736c4718-cbcb-4bdd-9649-12ccdf5fffec tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.272841 Aug 24 08:57:37.875221 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 179/348] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:37 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:37.901102 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4cf4dbc4-a7e0-4417-b5a9-d33415b5545c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:37.902319 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4cf4dbc4-a7e0-4417-b5a9-d33415b5545c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:37.915066 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4cf4dbc4-a7e0-4417-b5a9-d33415b5545c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:37.916076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4cf4dbc4-a7e0-4417-b5a9-d33415b5545c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:37.916799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4cf4dbc4-a7e0-4417-b5a9-d33415b5545c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:37.917810 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4cf4dbc4-a7e0-4417-b5a9-d33415b5545c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:37.918450 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4cf4dbc4-a7e0-4417-b5a9-d33415b5545c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:37.919176 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4cf4dbc4-a7e0-4417-b5a9-d33415b5545c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:37.997954 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4cf4dbc4-a7e0-4417-b5a9-d33415b5545c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:38.019939 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4cf4dbc4-a7e0-4417-b5a9-d33415b5545c tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1217 microversion: 2.1 time: 0.126821 Aug 24 08:57:38.021278 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 170/349] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:37 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:38.907404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-351a0998-e637-4a7d-8c33-2a15d7e4e529 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:38.907993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-351a0998-e637-4a7d-8c33-2a15d7e4e529 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:38.915936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-351a0998-e637-4a7d-8c33-2a15d7e4e529 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:38.916578 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-351a0998-e637-4a7d-8c33-2a15d7e4e529 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:38.917548 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-351a0998-e637-4a7d-8c33-2a15d7e4e529 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:38.918515 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-351a0998-e637-4a7d-8c33-2a15d7e4e529 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:38.919007 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-351a0998-e637-4a7d-8c33-2a15d7e4e529 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:38.933509 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-351a0998-e637-4a7d-8c33-2a15d7e4e529 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:39.057519 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-934ee03f-6065-45ad-b302-0ca2d19b7ca9 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:39.059044 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-934ee03f-6065-45ad-b302-0ca2d19b7ca9 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:39.066692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-934ee03f-6065-45ad-b302-0ca2d19b7ca9 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:39.067185 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-934ee03f-6065-45ad-b302-0ca2d19b7ca9 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:39.067615 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-934ee03f-6065-45ad-b302-0ca2d19b7ca9 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:39.068431 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-934ee03f-6065-45ad-b302-0ca2d19b7ca9 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:39.069153 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-934ee03f-6065-45ad-b302-0ca2d19b7ca9 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:39.069653 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-934ee03f-6065-45ad-b302-0ca2d19b7ca9 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:39.077881 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-351a0998-e637-4a7d-8c33-2a15d7e4e529 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:39.088597 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-351a0998-e637-4a7d-8c33-2a15d7e4e529 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.184389 Aug 24 08:57:39.088597 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 180/350] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:38 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:39.171210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-934ee03f-6065-45ad-b302-0ca2d19b7ca9 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:39.180161 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-934ee03f-6065-45ad-b302-0ca2d19b7ca9 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1265 microversion: 2.1 time: 0.127371 Aug 24 08:57:39.180786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 171/351] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:39 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:40.116031 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d0476728-eced-495c-815b-f55becac601c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:40.116738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d0476728-eced-495c-815b-f55becac601c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:40.126662 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d0476728-eced-495c-815b-f55becac601c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:40.127148 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d0476728-eced-495c-815b-f55becac601c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:40.128797 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d0476728-eced-495c-815b-f55becac601c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:40.128797 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d0476728-eced-495c-815b-f55becac601c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:40.129147 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d0476728-eced-495c-815b-f55becac601c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:40.129851 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d0476728-eced-495c-815b-f55becac601c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:40.213934 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-37276694-b0cb-4663-aaa3-189015b19613 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:40.214773 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-37276694-b0cb-4663-aaa3-189015b19613 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:40.230306 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-37276694-b0cb-4663-aaa3-189015b19613 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:40.232189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-37276694-b0cb-4663-aaa3-189015b19613 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:40.233575 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-37276694-b0cb-4663-aaa3-189015b19613 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:40.235516 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-37276694-b0cb-4663-aaa3-189015b19613 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:40.236368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-37276694-b0cb-4663-aaa3-189015b19613 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:40.238007 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-37276694-b0cb-4663-aaa3-189015b19613 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:40.376194 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-37276694-b0cb-4663-aaa3-189015b19613 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:40.385950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-37276694-b0cb-4663-aaa3-189015b19613 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1271 microversion: 2.1 time: 0.184647 Aug 24 08:57:40.387701 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 172/352] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:40 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:40.522372 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d0476728-eced-495c-815b-f55becac601c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:40.532195 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d0476728-eced-495c-815b-f55becac601c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.425149 Aug 24 08:57:40.544584 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 181/353] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:40 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:41.410547 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9fc0a6a1-34f2-4c46-bf59-d8ec2c05aeff tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:41.411153 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9fc0a6a1-34f2-4c46-bf59-d8ec2c05aeff tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:41.417375 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9fc0a6a1-34f2-4c46-bf59-d8ec2c05aeff tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:41.417861 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9fc0a6a1-34f2-4c46-bf59-d8ec2c05aeff tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:41.418293 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9fc0a6a1-34f2-4c46-bf59-d8ec2c05aeff tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:41.418989 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9fc0a6a1-34f2-4c46-bf59-d8ec2c05aeff tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:41.419458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9fc0a6a1-34f2-4c46-bf59-d8ec2c05aeff tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:41.419875 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9fc0a6a1-34f2-4c46-bf59-d8ec2c05aeff tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:41.557174 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-814e0c49-ab99-476b-a556-cfa329f46aa5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:41.558666 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-814e0c49-ab99-476b-a556-cfa329f46aa5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:41.569352 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-814e0c49-ab99-476b-a556-cfa329f46aa5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:41.569352 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-814e0c49-ab99-476b-a556-cfa329f46aa5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:41.569352 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-814e0c49-ab99-476b-a556-cfa329f46aa5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:41.569352 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-814e0c49-ab99-476b-a556-cfa329f46aa5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:41.569717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-814e0c49-ab99-476b-a556-cfa329f46aa5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:41.570323 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-814e0c49-ab99-476b-a556-cfa329f46aa5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:41.610041 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9fc0a6a1-34f2-4c46-bf59-d8ec2c05aeff tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:41.629605 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9fc0a6a1-34f2-4c46-bf59-d8ec2c05aeff tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1313 microversion: 2.1 time: 0.222823 Aug 24 08:57:41.631016 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 173/354] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:41 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:41.864863 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-814e0c49-ab99-476b-a556-cfa329f46aa5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:41.876900 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-814e0c49-ab99-476b-a556-cfa329f46aa5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.323590 Aug 24 08:57:41.890997 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 182/355] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:41 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:42.575079 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-45213943-f836-41a5-bcfa-4ceb3bb163b0 req-97b3cbc5-4718-4532-a8ed-ed9550edf530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3157fc-f36b-4f69-afb3-34b4e632b8a5", "tag": "98faaaa4-f069-4492-a0b9-94b6a5c04ac9"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:42.584815 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-45213943-f836-41a5-bcfa-4ceb3bb163b0 req-97b3cbc5-4718-4532-a8ed-ed9550edf530 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:42.585286 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-45213943-f836-41a5-bcfa-4ceb3bb163b0 req-97b3cbc5-4718-4532-a8ed-ed9550edf530 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:42.585755 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-45213943-f836-41a5-bcfa-4ceb3bb163b0 req-97b3cbc5-4718-4532-a8ed-ed9550edf530 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:42.599919 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-45213943-f836-41a5-bcfa-4ceb3bb163b0 req-97b3cbc5-4718-4532-a8ed-ed9550edf530 service nova] Creating event network-changed:98faaaa4-f069-4492-a0b9-94b6a5c04ac9 for instance ad3157fc-f36b-4f69-afb3-34b4e632b8a5 on hv-cinder-85221 Aug 24 08:57:42.607609 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-45213943-f836-41a5-bcfa-4ceb3bb163b0 req-97b3cbc5-4718-4532-a8ed-ed9550edf530 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036206 Aug 24 08:57:42.608473 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 174/356] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:42.652587 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5cab24de-2012-495b-bbe7-3b1af575e965 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:42.653197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5cab24de-2012-495b-bbe7-3b1af575e965 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:42.660878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5cab24de-2012-495b-bbe7-3b1af575e965 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:42.661386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5cab24de-2012-495b-bbe7-3b1af575e965 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:42.661823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5cab24de-2012-495b-bbe7-3b1af575e965 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:42.662526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5cab24de-2012-495b-bbe7-3b1af575e965 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:42.662983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5cab24de-2012-495b-bbe7-3b1af575e965 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:42.663409 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5cab24de-2012-495b-bbe7-3b1af575e965 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:42.841815 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5cab24de-2012-495b-bbe7-3b1af575e965 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:42.854869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5cab24de-2012-495b-bbe7-3b1af575e965 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1313 microversion: 2.1 time: 0.203603 Aug 24 08:57:42.854869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 183/357] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:42 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:42.905283 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3b6049db-9d27-4f53-9e69-f8a4ec1e5717 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:42.906638 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3b6049db-9d27-4f53-9e69-f8a4ec1e5717 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:42.917901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3b6049db-9d27-4f53-9e69-f8a4ec1e5717 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:42.919005 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3b6049db-9d27-4f53-9e69-f8a4ec1e5717 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:42.919743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3b6049db-9d27-4f53-9e69-f8a4ec1e5717 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:42.921081 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3b6049db-9d27-4f53-9e69-f8a4ec1e5717 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:42.921908 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3b6049db-9d27-4f53-9e69-f8a4ec1e5717 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:42.922663 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3b6049db-9d27-4f53-9e69-f8a4ec1e5717 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:43.093239 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3b6049db-9d27-4f53-9e69-f8a4ec1e5717 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:43.104325 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3b6049db-9d27-4f53-9e69-f8a4ec1e5717 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.208230 Aug 24 08:57:43.105266 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 175/358] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:42 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:43.874741 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5275525a-ad37-42c1-aabe-4ffed519a048 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:43.875812 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5275525a-ad37-42c1-aabe-4ffed519a048 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:43.883971 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5275525a-ad37-42c1-aabe-4ffed519a048 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:43.884456 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5275525a-ad37-42c1-aabe-4ffed519a048 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:43.884913 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5275525a-ad37-42c1-aabe-4ffed519a048 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:43.885618 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5275525a-ad37-42c1-aabe-4ffed519a048 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:43.886060 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5275525a-ad37-42c1-aabe-4ffed519a048 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:43.886480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5275525a-ad37-42c1-aabe-4ffed519a048 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:44.089067 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5275525a-ad37-42c1-aabe-4ffed519a048 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:44.102145 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5275525a-ad37-42c1-aabe-4ffed519a048 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1313 microversion: 2.1 time: 0.231904 Aug 24 08:57:44.103156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 184/359] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:43 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:44.138170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4e33ea5d-6893-471f-b03e-e7fb60b502c3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:44.139045 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4e33ea5d-6893-471f-b03e-e7fb60b502c3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:44.145950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4e33ea5d-6893-471f-b03e-e7fb60b502c3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:44.146566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4e33ea5d-6893-471f-b03e-e7fb60b502c3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:44.151241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4e33ea5d-6893-471f-b03e-e7fb60b502c3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:44.151241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4e33ea5d-6893-471f-b03e-e7fb60b502c3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:44.151241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4e33ea5d-6893-471f-b03e-e7fb60b502c3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:44.151241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4e33ea5d-6893-471f-b03e-e7fb60b502c3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:44.300639 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4e33ea5d-6893-471f-b03e-e7fb60b502c3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:44.304431 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:44.309436 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4e33ea5d-6893-471f-b03e-e7fb60b502c3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1522 microversion: 2.1 time: 0.175137 Aug 24 08:57:44.310029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 176/360] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:44 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:45.127805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-68bd32dc-3335-4272-9e52-7eefcf1a948f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:45.128989 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-68bd32dc-3335-4272-9e52-7eefcf1a948f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:45.139221 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-68bd32dc-3335-4272-9e52-7eefcf1a948f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:45.139923 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-68bd32dc-3335-4272-9e52-7eefcf1a948f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:45.140327 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-68bd32dc-3335-4272-9e52-7eefcf1a948f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:45.141148 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-68bd32dc-3335-4272-9e52-7eefcf1a948f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:45.141633 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-68bd32dc-3335-4272-9e52-7eefcf1a948f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:45.142063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-68bd32dc-3335-4272-9e52-7eefcf1a948f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:45.301946 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-68bd32dc-3335-4272-9e52-7eefcf1a948f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:45.310348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-68bd32dc-3335-4272-9e52-7eefcf1a948f tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1313 microversion: 2.1 time: 0.190368 Aug 24 08:57:45.310956 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 185/361] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:45 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:45.330970 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-aa3d348c-3edd-4b0f-bbe5-88710d9e2ecc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:45.334661 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-aa3d348c-3edd-4b0f-bbe5-88710d9e2ecc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:45.338754 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aa3d348c-3edd-4b0f-bbe5-88710d9e2ecc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:45.339243 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aa3d348c-3edd-4b0f-bbe5-88710d9e2ecc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:45.339675 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aa3d348c-3edd-4b0f-bbe5-88710d9e2ecc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:45.340389 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aa3d348c-3edd-4b0f-bbe5-88710d9e2ecc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:45.340881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aa3d348c-3edd-4b0f-bbe5-88710d9e2ecc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:45.341306 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aa3d348c-3edd-4b0f-bbe5-88710d9e2ecc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:45.498127 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-aa3d348c-3edd-4b0f-bbe5-88710d9e2ecc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:45.507033 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-aa3d348c-3edd-4b0f-bbe5-88710d9e2ecc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1502 microversion: 2.1 time: 0.180580 Aug 24 08:57:45.507626 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 177/362] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:45 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:45.540680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9c9eb256-f557-430c-8cc9-92be8b130ed5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:45.541882 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9c9eb256-f557-430c-8cc9-92be8b130ed5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:45.553242 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c9eb256-f557-430c-8cc9-92be8b130ed5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:45.554023 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c9eb256-f557-430c-8cc9-92be8b130ed5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:45.554809 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c9eb256-f557-430c-8cc9-92be8b130ed5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:45.556090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c9eb256-f557-430c-8cc9-92be8b130ed5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:45.556852 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c9eb256-f557-430c-8cc9-92be8b130ed5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:45.557338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c9eb256-f557-430c-8cc9-92be8b130ed5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:45.714100 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9c9eb256-f557-430c-8cc9-92be8b130ed5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:45.723815 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9c9eb256-f557-430c-8cc9-92be8b130ed5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1516 microversion: 2.1 time: 0.190125 Aug 24 08:57:45.729994 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 186/363] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:45 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:46.332021 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1c732e14-2460-4c10-a2a1-8736906aabfe tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:46.332592 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1c732e14-2460-4c10-a2a1-8736906aabfe tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:46.338883 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1c732e14-2460-4c10-a2a1-8736906aabfe tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:46.339346 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1c732e14-2460-4c10-a2a1-8736906aabfe tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:46.339776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1c732e14-2460-4c10-a2a1-8736906aabfe tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:46.340506 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1c732e14-2460-4c10-a2a1-8736906aabfe tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:46.340979 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1c732e14-2460-4c10-a2a1-8736906aabfe tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:46.341399 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1c732e14-2460-4c10-a2a1-8736906aabfe tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:46.482520 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1c732e14-2460-4c10-a2a1-8736906aabfe tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:46.490769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1c732e14-2460-4c10-a2a1-8736906aabfe tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1313 microversion: 2.1 time: 0.163136 Aug 24 08:57:46.491353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 178/364] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:46 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:47.513494 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2ddff86c-f36a-4d3b-9e43-3df810c970ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:47.514497 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2ddff86c-f36a-4d3b-9e43-3df810c970ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:47.517499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:47.518589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=6 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:47.527520 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2ddff86c-f36a-4d3b-9e43-3df810c970ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:47.528346 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2ddff86c-f36a-4d3b-9e43-3df810c970ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:47.529383 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2ddff86c-f36a-4d3b-9e43-3df810c970ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:47.530674 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2ddff86c-f36a-4d3b-9e43-3df810c970ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:47.531475 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2ddff86c-f36a-4d3b-9e43-3df810c970ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:47.532210 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2ddff86c-f36a-4d3b-9e43-3df810c970ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:47.751307 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2ddff86c-f36a-4d3b-9e43-3df810c970ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:47.759497 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2ddff86c-f36a-4d3b-9e43-3df810c970ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1313 microversion: 2.1 time: 0.250777 Aug 24 08:57:47.760086 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 187/365] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:47 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:48.745606 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d122b05e-874b-4c2a-95c3-1b56dd9c07a0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:48.748056 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d122b05e-874b-4c2a-95c3-1b56dd9c07a0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:48.750016 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:48.756749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d122b05e-874b-4c2a-95c3-1b56dd9c07a0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:48.757323 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d122b05e-874b-4c2a-95c3-1b56dd9c07a0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:48.775467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d122b05e-874b-4c2a-95c3-1b56dd9c07a0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:48.775467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d122b05e-874b-4c2a-95c3-1b56dd9c07a0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:48.775467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d122b05e-874b-4c2a-95c3-1b56dd9c07a0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:48.775467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d122b05e-874b-4c2a-95c3-1b56dd9c07a0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:48.783337 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-d122b05e-874b-4c2a-95c3-1b56dd9c07a0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lazy-loading 'flavor' on Instance uuid 93e80c6c-b61f-42b6-9c29-cf86c7099e57 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:57:48.794080 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c3282b7f-814c-4594-b17f-af9fad508def tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:48.795061 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c3282b7f-814c-4594-b17f-af9fad508def tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:48.803832 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c3282b7f-814c-4594-b17f-af9fad508def tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:48.804433 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c3282b7f-814c-4594-b17f-af9fad508def tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:48.805041 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c3282b7f-814c-4594-b17f-af9fad508def tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:48.805845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c3282b7f-814c-4594-b17f-af9fad508def tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:48.806621 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c3282b7f-814c-4594-b17f-af9fad508def tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:48.807303 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c3282b7f-814c-4594-b17f-af9fad508def tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:48.959741 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c3282b7f-814c-4594-b17f-af9fad508def tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:48.968988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c3282b7f-814c-4594-b17f-af9fad508def tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1313 microversion: 2.1 time: 0.180965 Aug 24 08:57:48.969834 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 188/366] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:48 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:49.252881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d122b05e-874b-4c2a-95c3-1b56dd9c07a0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "POST /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57/action" status: 200 len: 32 microversion: 2.1 time: 0.511285 Aug 24 08:57:49.256083 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 179/367] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 08:57:48 2022] POST /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57/action => generated 32 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 08:57:49.269743 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b9196e9d-ee36-4e0d-8166-e4301e6314c9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:49.270365 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b9196e9d-ee36-4e0d-8166-e4301e6314c9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:49.288465 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b9196e9d-ee36-4e0d-8166-e4301e6314c9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:49.289142 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b9196e9d-ee36-4e0d-8166-e4301e6314c9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:49.289703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b9196e9d-ee36-4e0d-8166-e4301e6314c9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:49.290481 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b9196e9d-ee36-4e0d-8166-e4301e6314c9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:49.291001 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b9196e9d-ee36-4e0d-8166-e4301e6314c9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:49.291667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b9196e9d-ee36-4e0d-8166-e4301e6314c9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:49.523462 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b9196e9d-ee36-4e0d-8166-e4301e6314c9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:49.540055 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b9196e9d-ee36-4e0d-8166-e4301e6314c9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.271285 Aug 24 08:57:49.549477 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 189/368] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:49 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:49.995826 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-26dee124-bc15-4021-8182-e3adbaa1c21e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:49.996832 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-26dee124-bc15-4021-8182-e3adbaa1c21e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:50.005015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-26dee124-bc15-4021-8182-e3adbaa1c21e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:50.005505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-26dee124-bc15-4021-8182-e3adbaa1c21e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:50.005945 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-26dee124-bc15-4021-8182-e3adbaa1c21e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:50.006656 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-26dee124-bc15-4021-8182-e3adbaa1c21e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:50.007107 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-26dee124-bc15-4021-8182-e3adbaa1c21e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:50.007530 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-26dee124-bc15-4021-8182-e3adbaa1c21e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:50.179878 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-26dee124-bc15-4021-8182-e3adbaa1c21e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:50.187795 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-26dee124-bc15-4021-8182-e3adbaa1c21e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1313 microversion: 2.1 time: 0.200210 Aug 24 08:57:50.188447 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 180/369] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:49 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:50.558998 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e69f18dc-5cf8-42d4-abfd-51ac37414ecb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:50.559592 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e69f18dc-5cf8-42d4-abfd-51ac37414ecb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:50.566059 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e69f18dc-5cf8-42d4-abfd-51ac37414ecb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:50.566549 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e69f18dc-5cf8-42d4-abfd-51ac37414ecb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:50.566982 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e69f18dc-5cf8-42d4-abfd-51ac37414ecb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:50.567685 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e69f18dc-5cf8-42d4-abfd-51ac37414ecb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:50.568146 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e69f18dc-5cf8-42d4-abfd-51ac37414ecb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:50.568593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e69f18dc-5cf8-42d4-abfd-51ac37414ecb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:50.722924 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e69f18dc-5cf8-42d4-abfd-51ac37414ecb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:50.732392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e69f18dc-5cf8-42d4-abfd-51ac37414ecb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.177216 Aug 24 08:57:50.733231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 190/370] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:50 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:51.124973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-31ff4eaf-337c-41c8-929e-37508dfc170f req-6ea33015-95d8-44f0-b35b-912ad60aec30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3157fc-f36b-4f69-afb3-34b4e632b8a5", "name": "network-vif-plugged", "status": "completed", "tag": "98faaaa4-f069-4492-a0b9-94b6a5c04ac9"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:51.141772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-31ff4eaf-337c-41c8-929e-37508dfc170f req-6ea33015-95d8-44f0-b35b-912ad60aec30 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:51.142217 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-31ff4eaf-337c-41c8-929e-37508dfc170f req-6ea33015-95d8-44f0-b35b-912ad60aec30 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:51.144446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-31ff4eaf-337c-41c8-929e-37508dfc170f req-6ea33015-95d8-44f0-b35b-912ad60aec30 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:51.156130 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-31ff4eaf-337c-41c8-929e-37508dfc170f req-6ea33015-95d8-44f0-b35b-912ad60aec30 service nova] Creating event network-vif-plugged:98faaaa4-f069-4492-a0b9-94b6a5c04ac9 for instance ad3157fc-f36b-4f69-afb3-34b4e632b8a5 on hv-cinder-85221 Aug 24 08:57:51.161434 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-31ff4eaf-337c-41c8-929e-37508dfc170f req-6ea33015-95d8-44f0-b35b-912ad60aec30 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042069 Aug 24 08:57:51.162264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 181/371] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:57:51.213536 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4096ccd2-ec0f-459e-9c57-5d291a60111b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:51.214632 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4096ccd2-ec0f-459e-9c57-5d291a60111b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:51.222696 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4096ccd2-ec0f-459e-9c57-5d291a60111b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:51.223188 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4096ccd2-ec0f-459e-9c57-5d291a60111b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:51.223620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4096ccd2-ec0f-459e-9c57-5d291a60111b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:51.224335 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4096ccd2-ec0f-459e-9c57-5d291a60111b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:51.224832 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4096ccd2-ec0f-459e-9c57-5d291a60111b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:51.225257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4096ccd2-ec0f-459e-9c57-5d291a60111b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:51.473438 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4096ccd2-ec0f-459e-9c57-5d291a60111b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:51.483517 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4096ccd2-ec0f-459e-9c57-5d291a60111b tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1313 microversion: 2.1 time: 0.276180 Aug 24 08:57:51.566917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 191/372] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:51 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:51.765057 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-506c8dad-b0cf-44e5-a929-dc2320ed9329 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:51.766152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-506c8dad-b0cf-44e5-a929-dc2320ed9329 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:51.774770 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-506c8dad-b0cf-44e5-a929-dc2320ed9329 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:51.775733 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-506c8dad-b0cf-44e5-a929-dc2320ed9329 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:51.776495 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-506c8dad-b0cf-44e5-a929-dc2320ed9329 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:51.778281 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-506c8dad-b0cf-44e5-a929-dc2320ed9329 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:51.778281 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-506c8dad-b0cf-44e5-a929-dc2320ed9329 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:51.778902 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-506c8dad-b0cf-44e5-a929-dc2320ed9329 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:51.983426 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-506c8dad-b0cf-44e5-a929-dc2320ed9329 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:51.991848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-506c8dad-b0cf-44e5-a929-dc2320ed9329 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.232535 Aug 24 08:57:51.992453 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 182/373] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:51 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:52.507228 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8128f34b-df9c-4933-9343-46e29ce40b28 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:52.507843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8128f34b-df9c-4933-9343-46e29ce40b28 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:52.510496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:52.515157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8128f34b-df9c-4933-9343-46e29ce40b28 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:52.515635 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8128f34b-df9c-4933-9343-46e29ce40b28 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:52.516070 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8128f34b-df9c-4933-9343-46e29ce40b28 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:52.516801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8128f34b-df9c-4933-9343-46e29ce40b28 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:52.517251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8128f34b-df9c-4933-9343-46e29ce40b28 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:52.518171 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8128f34b-df9c-4933-9343-46e29ce40b28 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:52.682884 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8128f34b-df9c-4933-9343-46e29ce40b28 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:52.687463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:52.693290 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8128f34b-df9c-4933-9343-46e29ce40b28 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1313 microversion: 2.1 time: 0.189833 Aug 24 08:57:52.697165 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 192/374] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:52 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:53.014528 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-55e9be69-19f8-4ce9-9688-26b3cf542f11 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:53.014528 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-55e9be69-19f8-4ce9-9688-26b3cf542f11 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:53.027672 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-55e9be69-19f8-4ce9-9688-26b3cf542f11 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:53.027672 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-55e9be69-19f8-4ce9-9688-26b3cf542f11 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:53.027672 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-55e9be69-19f8-4ce9-9688-26b3cf542f11 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:53.027672 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-55e9be69-19f8-4ce9-9688-26b3cf542f11 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:53.028123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-55e9be69-19f8-4ce9-9688-26b3cf542f11 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:53.028123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-55e9be69-19f8-4ce9-9688-26b3cf542f11 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:53.190972 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-55e9be69-19f8-4ce9-9688-26b3cf542f11 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:53.199384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-55e9be69-19f8-4ce9-9688-26b3cf542f11 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.189457 Aug 24 08:57:53.199975 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 183/375] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:53 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:53.727726 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f97dcd69-cac8-48f9-bf76-3d9e6d70b6ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:53.728348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f97dcd69-cac8-48f9-bf76-3d9e6d70b6ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:53.735797 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f97dcd69-cac8-48f9-bf76-3d9e6d70b6ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:53.736926 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f97dcd69-cac8-48f9-bf76-3d9e6d70b6ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:53.737385 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f97dcd69-cac8-48f9-bf76-3d9e6d70b6ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:53.738081 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f97dcd69-cac8-48f9-bf76-3d9e6d70b6ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:53.738538 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f97dcd69-cac8-48f9-bf76-3d9e6d70b6ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:53.738970 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f97dcd69-cac8-48f9-bf76-3d9e6d70b6ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:53.941273 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f97dcd69-cac8-48f9-bf76-3d9e6d70b6ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:53.956801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f97dcd69-cac8-48f9-bf76-3d9e6d70b6ad tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1313 microversion: 2.1 time: 0.232483 Aug 24 08:57:53.957884 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 193/376] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:53 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:54.227487 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3e71f7fc-4e8e-42f5-bab1-feca91cd9a73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:54.230078 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3e71f7fc-4e8e-42f5-bab1-feca91cd9a73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:54.243714 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3e71f7fc-4e8e-42f5-bab1-feca91cd9a73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:54.244651 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3e71f7fc-4e8e-42f5-bab1-feca91cd9a73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:54.245500 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3e71f7fc-4e8e-42f5-bab1-feca91cd9a73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:54.246976 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3e71f7fc-4e8e-42f5-bab1-feca91cd9a73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:54.247812 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3e71f7fc-4e8e-42f5-bab1-feca91cd9a73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:54.248590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3e71f7fc-4e8e-42f5-bab1-feca91cd9a73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:54.420525 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3e71f7fc-4e8e-42f5-bab1-feca91cd9a73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:54.430348 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3e71f7fc-4e8e-42f5-bab1-feca91cd9a73 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.211343 Aug 24 08:57:54.431449 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 184/377] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:54 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:54.979382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4b4dde71-365f-418e-87c4-de79cf4aa588 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:54.979988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4b4dde71-365f-418e-87c4-de79cf4aa588 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:54.986442 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4b4dde71-365f-418e-87c4-de79cf4aa588 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:54.986902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4b4dde71-365f-418e-87c4-de79cf4aa588 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:54.987332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4b4dde71-365f-418e-87c4-de79cf4aa588 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:54.988058 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4b4dde71-365f-418e-87c4-de79cf4aa588 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:54.988511 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4b4dde71-365f-418e-87c4-de79cf4aa588 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:54.988957 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4b4dde71-365f-418e-87c4-de79cf4aa588 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:55.158187 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4b4dde71-365f-418e-87c4-de79cf4aa588 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:55.166397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4b4dde71-365f-418e-87c4-de79cf4aa588 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1497 microversion: 2.1 time: 0.190719 Aug 24 08:57:55.167051 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 194/378] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:54 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:55.454016 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9e8d0b9d-5284-45d0-adae-1974a77a01ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:55.455865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9e8d0b9d-5284-45d0-adae-1974a77a01ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:55.458502 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:55.465149 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e8d0b9d-5284-45d0-adae-1974a77a01ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:55.465679 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e8d0b9d-5284-45d0-adae-1974a77a01ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:55.466172 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e8d0b9d-5284-45d0-adae-1974a77a01ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:55.466931 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e8d0b9d-5284-45d0-adae-1974a77a01ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:55.467416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e8d0b9d-5284-45d0-adae-1974a77a01ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:55.467840 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e8d0b9d-5284-45d0-adae-1974a77a01ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:55.664755 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9e8d0b9d-5284-45d0-adae-1974a77a01ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:55.673869 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9e8d0b9d-5284-45d0-adae-1974a77a01ca tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.226202 Aug 24 08:57:55.674856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 185/379] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:55 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:56.696746 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0f7f5fe8-353c-4f15-a5f3-cce69063d165 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:56.697643 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0f7f5fe8-353c-4f15-a5f3-cce69063d165 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:56.704650 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f7f5fe8-353c-4f15-a5f3-cce69063d165 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:56.705135 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f7f5fe8-353c-4f15-a5f3-cce69063d165 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:56.705565 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f7f5fe8-353c-4f15-a5f3-cce69063d165 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:56.706265 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f7f5fe8-353c-4f15-a5f3-cce69063d165 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:56.706711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f7f5fe8-353c-4f15-a5f3-cce69063d165 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:56.707134 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f7f5fe8-353c-4f15-a5f3-cce69063d165 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:56.849933 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0f7f5fe8-353c-4f15-a5f3-cce69063d165 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:56.859504 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0f7f5fe8-353c-4f15-a5f3-cce69063d165 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.167223 Aug 24 08:57:56.860013 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 195/380] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:56 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:56.948714 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cb11c8e6-db3f-48e5-b80b-7303bc87ddf8 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:56.949316 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-cb11c8e6-db3f-48e5-b80b-7303bc87ddf8 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:56.956320 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cb11c8e6-db3f-48e5-b80b-7303bc87ddf8 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:56.956916 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cb11c8e6-db3f-48e5-b80b-7303bc87ddf8 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:56.957268 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cb11c8e6-db3f-48e5-b80b-7303bc87ddf8 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:56.957975 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cb11c8e6-db3f-48e5-b80b-7303bc87ddf8 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:56.958421 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cb11c8e6-db3f-48e5-b80b-7303bc87ddf8 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:56.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cb11c8e6-db3f-48e5-b80b-7303bc87ddf8 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:56.987029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-cb11c8e6-db3f-48e5-b80b-7303bc87ddf8 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Going to try to terminate instance {{(pid=132985) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:57:57.498942 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-cb11c8e6-db3f-48e5-b80b-7303bc87ddf8 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 204 len: 0 microversion: 2.1 time: 0.553106 Aug 24 08:57:57.499383 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 186/381] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 08:57:56 2022] DELETE /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:57:57.510324 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0cf58c5d-b3a6-4b1b-94d9-2067a7db570e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:57.510951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0cf58c5d-b3a6-4b1b-94d9-2067a7db570e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:57.521032 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0cf58c5d-b3a6-4b1b-94d9-2067a7db570e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:57.522083 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0cf58c5d-b3a6-4b1b-94d9-2067a7db570e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:57.522946 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0cf58c5d-b3a6-4b1b-94d9-2067a7db570e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:57.524970 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0cf58c5d-b3a6-4b1b-94d9-2067a7db570e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:57.526062 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0cf58c5d-b3a6-4b1b-94d9-2067a7db570e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:57.526841 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0cf58c5d-b3a6-4b1b-94d9-2067a7db570e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:57.696034 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0cf58c5d-b3a6-4b1b-94d9-2067a7db570e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:57.704683 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0cf58c5d-b3a6-4b1b-94d9-2067a7db570e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1503 microversion: 2.1 time: 0.198371 Aug 24 08:57:57.705399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 196/382] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:57 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:57.884630 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-780d1e91-9a2e-46cb-9a1b-b80bfa220adc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:57.885292 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-780d1e91-9a2e-46cb-9a1b-b80bfa220adc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:57.891465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-780d1e91-9a2e-46cb-9a1b-b80bfa220adc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:57.891954 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-780d1e91-9a2e-46cb-9a1b-b80bfa220adc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:57.892484 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-780d1e91-9a2e-46cb-9a1b-b80bfa220adc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:57.893222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-780d1e91-9a2e-46cb-9a1b-b80bfa220adc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:57.893669 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-780d1e91-9a2e-46cb-9a1b-b80bfa220adc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:57.894091 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-780d1e91-9a2e-46cb-9a1b-b80bfa220adc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:58.058670 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-780d1e91-9a2e-46cb-9a1b-b80bfa220adc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:58.073361 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-780d1e91-9a2e-46cb-9a1b-b80bfa220adc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.192157 Aug 24 08:57:58.074042 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 187/383] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:57 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:58.728947 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fbad6392-3f53-470e-a4ac-1de21dfa1f6e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:58.730132 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fbad6392-3f53-470e-a4ac-1de21dfa1f6e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:58.748995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbad6392-3f53-470e-a4ac-1de21dfa1f6e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:58.750586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbad6392-3f53-470e-a4ac-1de21dfa1f6e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:58.751334 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbad6392-3f53-470e-a4ac-1de21dfa1f6e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:58.752869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbad6392-3f53-470e-a4ac-1de21dfa1f6e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:58.753665 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbad6392-3f53-470e-a4ac-1de21dfa1f6e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:58.754605 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbad6392-3f53-470e-a4ac-1de21dfa1f6e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:58.952251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fbad6392-3f53-470e-a4ac-1de21dfa1f6e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:58.958529 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fbad6392-3f53-470e-a4ac-1de21dfa1f6e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1503 microversion: 2.1 time: 0.235886 Aug 24 08:57:58.959126 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 197/384] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:58 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:59.094940 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6de2c819-1830-43a0-a318-90905b61a671 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:59.095958 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6de2c819-1830-43a0-a318-90905b61a671 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:59.102610 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6de2c819-1830-43a0-a318-90905b61a671 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:59.103235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6de2c819-1830-43a0-a318-90905b61a671 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:59.103770 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6de2c819-1830-43a0-a318-90905b61a671 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:59.104628 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6de2c819-1830-43a0-a318-90905b61a671 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:59.105218 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6de2c819-1830-43a0-a318-90905b61a671 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:59.105654 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6de2c819-1830-43a0-a318-90905b61a671 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:59.322511 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6de2c819-1830-43a0-a318-90905b61a671 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:59.335448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6de2c819-1830-43a0-a318-90905b61a671 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.244134 Aug 24 08:57:59.336449 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 188/385] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:59 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:59.985129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9192b05e-a1a0-4fda-b6a5-5cfdb9fae379 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:59.987983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9192b05e-a1a0-4fda-b6a5-5cfdb9fae379 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:00.000861 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9192b05e-a1a0-4fda-b6a5-5cfdb9fae379 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:00.002248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9192b05e-a1a0-4fda-b6a5-5cfdb9fae379 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:00.002998 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9192b05e-a1a0-4fda-b6a5-5cfdb9fae379 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:00.005140 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9192b05e-a1a0-4fda-b6a5-5cfdb9fae379 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:00.005140 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9192b05e-a1a0-4fda-b6a5-5cfdb9fae379 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:00.005873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9192b05e-a1a0-4fda-b6a5-5cfdb9fae379 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:00.368908 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f838e2c6-3310-4d22-b234-eba697e3a282 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:00.370183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f838e2c6-3310-4d22-b234-eba697e3a282 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:00.377445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f838e2c6-3310-4d22-b234-eba697e3a282 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:00.378335 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f838e2c6-3310-4d22-b234-eba697e3a282 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:00.378793 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f838e2c6-3310-4d22-b234-eba697e3a282 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:00.379535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f838e2c6-3310-4d22-b234-eba697e3a282 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:00.379996 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f838e2c6-3310-4d22-b234-eba697e3a282 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:00.380427 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f838e2c6-3310-4d22-b234-eba697e3a282 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:00.503649 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9192b05e-a1a0-4fda-b6a5-5cfdb9fae379 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:00.516748 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9192b05e-a1a0-4fda-b6a5-5cfdb9fae379 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1503 microversion: 2.1 time: 0.538890 Aug 24 08:58:00.541589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 198/386] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:59 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1503 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:00.613174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f838e2c6-3310-4d22-b234-eba697e3a282 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:00.632145 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f838e2c6-3310-4d22-b234-eba697e3a282 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.268472 Aug 24 08:58:00.632783 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 189/387] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:00 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:00.934804 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-2d19aebf-925e-4b55-803c-49cd233c0186 req-1157a114-14a8-4718-9813-173115d7f825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3157fc-f36b-4f69-afb3-34b4e632b8a5", "name": "network-vif-deleted", "tag": "98faaaa4-f069-4492-a0b9-94b6a5c04ac9"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:00.946379 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-2d19aebf-925e-4b55-803c-49cd233c0186 req-1157a114-14a8-4718-9813-173115d7f825 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:00.946862 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-2d19aebf-925e-4b55-803c-49cd233c0186 req-1157a114-14a8-4718-9813-173115d7f825 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:00.947293 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-2d19aebf-925e-4b55-803c-49cd233c0186 req-1157a114-14a8-4718-9813-173115d7f825 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:00.961110 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-2d19aebf-925e-4b55-803c-49cd233c0186 req-1157a114-14a8-4718-9813-173115d7f825 service nova] Creating event network-vif-deleted:98faaaa4-f069-4492-a0b9-94b6a5c04ac9 for instance ad3157fc-f36b-4f69-afb3-34b4e632b8a5 on hv-cinder-85221 Aug 24 08:58:00.966535 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-2d19aebf-925e-4b55-803c-49cd233c0186 req-1157a114-14a8-4718-9813-173115d7f825 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035205 Aug 24 08:58:00.967149 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 199/388] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:58:01.541645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:01.542277 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:01.549295 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:01.549782 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:01.550419 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:01.551295 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:01.552000 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:01.552615 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:01.575092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:01.589108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:01.589600 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:01.590034 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:01.590697 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lazy-loading 'fault' on Instance uuid ad3157fc-f36b-4f69-afb3-34b4e632b8a5 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:58:01.643816 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:01.652125 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e56f3a96-085d-45a4-95d9-55009cc34980 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1303 microversion: 2.1 time: 0.114601 Aug 24 08:58:01.653833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 190/389] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:01 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:01.671452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-bf413b74-ff8a-419a-b446-d357d3423318 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:01.672157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-bf413b74-ff8a-419a-b446-d357d3423318 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:01.679564 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bf413b74-ff8a-419a-b446-d357d3423318 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:01.681479 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bf413b74-ff8a-419a-b446-d357d3423318 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:01.681479 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bf413b74-ff8a-419a-b446-d357d3423318 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:01.681479 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bf413b74-ff8a-419a-b446-d357d3423318 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:01.681874 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bf413b74-ff8a-419a-b446-d357d3423318 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:01.682117 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bf413b74-ff8a-419a-b446-d357d3423318 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:01.839204 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-bf413b74-ff8a-419a-b446-d357d3423318 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:01.848150 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-bf413b74-ff8a-419a-b446-d357d3423318 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.181382 Aug 24 08:58:01.848796 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 200/390] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:01 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:02.675244 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:02.675873 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:02.682686 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:02.683162 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:02.683584 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:02.684278 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:02.684745 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:02.685209 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:02.718008 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:02.718391 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:02.718827 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:02.719273 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lazy-loading 'fault' on Instance uuid ad3157fc-f36b-4f69-afb3-34b4e632b8a5 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:58:02.763621 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:02.772183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9d4da27b-f99a-4895-8d75-f4b21ed6b73e tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1303 microversion: 2.1 time: 0.101458 Aug 24 08:58:02.772790 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 191/391] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:02 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:02.870495 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7998d59b-1fa4-433b-8c74-3eb2ff2ef82a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:02.871177 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7998d59b-1fa4-433b-8c74-3eb2ff2ef82a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:02.880140 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7998d59b-1fa4-433b-8c74-3eb2ff2ef82a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:02.880140 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7998d59b-1fa4-433b-8c74-3eb2ff2ef82a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:02.880140 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7998d59b-1fa4-433b-8c74-3eb2ff2ef82a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:02.880140 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7998d59b-1fa4-433b-8c74-3eb2ff2ef82a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:02.880649 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7998d59b-1fa4-433b-8c74-3eb2ff2ef82a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:02.880904 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7998d59b-1fa4-433b-8c74-3eb2ff2ef82a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:03.064360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7998d59b-1fa4-433b-8c74-3eb2ff2ef82a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:03.072476 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7998d59b-1fa4-433b-8c74-3eb2ff2ef82a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.205804 Aug 24 08:58:03.073346 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 201/392] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:02 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:03.794792 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:03.795527 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:03.803277 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:03.803692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:03.804127 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:03.804954 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:03.805514 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:03.805936 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:03.840311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:03.840822 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:03.841262 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:03.841711 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lazy-loading 'fault' on Instance uuid ad3157fc-f36b-4f69-afb3-34b4e632b8a5 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:58:03.886515 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb815fa9f45a4b1db1f30fbfaeb3c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9753d09aeea45378d637bf28536bb7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:03.894734 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-470b234d-ac36-4398-a06f-5c373f4c3511 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 200 len: 1303 microversion: 2.1 time: 0.104622 Aug 24 08:58:03.895306 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 192/393] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:03 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:04.095522 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a80b39f6-5594-44de-ae8b-f5cc56f87e90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:04.096273 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a80b39f6-5594-44de-ae8b-f5cc56f87e90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:04.104603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a80b39f6-5594-44de-ae8b-f5cc56f87e90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:04.105528 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a80b39f6-5594-44de-ae8b-f5cc56f87e90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:04.105968 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a80b39f6-5594-44de-ae8b-f5cc56f87e90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:04.106932 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a80b39f6-5594-44de-ae8b-f5cc56f87e90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:04.107411 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a80b39f6-5594-44de-ae8b-f5cc56f87e90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:04.108482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a80b39f6-5594-44de-ae8b-f5cc56f87e90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:04.305561 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a80b39f6-5594-44de-ae8b-f5cc56f87e90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:04.314755 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a80b39f6-5594-44de-ae8b-f5cc56f87e90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.223655 Aug 24 08:58:04.315347 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 202/394] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:04 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:04.411459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-35c93f0b-cc29-446d-bacd-79db679c39a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "958988cd-7179-4688-8a5c-6271d68eec9b", "device": "/dev/sdb"}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:04.414695 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-35c93f0b-cc29-446d-bacd-79db679c39a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:04.421461 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-35c93f0b-cc29-446d-bacd-79db679c39a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:04.422071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-35c93f0b-cc29-446d-bacd-79db679c39a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:04.422507 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-35c93f0b-cc29-446d-bacd-79db679c39a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:04.423697 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-35c93f0b-cc29-446d-bacd-79db679c39a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:04.424145 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-35c93f0b-cc29-446d-bacd-79db679c39a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:04.424600 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-35c93f0b-cc29-446d-bacd-79db679c39a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:04.916607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-abb35320-962c-4b01-8c90-408f1ff87574 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:04.917270 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-abb35320-962c-4b01-8c90-408f1ff87574 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] [instance: ad3157fc-f36b-4f69-afb3-34b4e632b8a5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:04.924182 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-abb35320-962c-4b01-8c90-408f1ff87574 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:04.924686 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-abb35320-962c-4b01-8c90-408f1ff87574 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:04.925124 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-abb35320-962c-4b01-8c90-408f1ff87574 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:04.925848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-abb35320-962c-4b01-8c90-408f1ff87574 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:04.926298 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-abb35320-962c-4b01-8c90-408f1ff87574 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:04.926718 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-abb35320-962c-4b01-8c90-408f1ff87574 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:04.941794 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-abb35320-962c-4b01-8c90-408f1ff87574 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] HTTP exception thrown: Instance ad3157fc-f36b-4f69-afb3-34b4e632b8a5 could not be found. Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-abb35320-962c-4b01-8c90-408f1ff87574 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Request method failure captured: Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 HTTP/1.1 Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBefS5XUE0k9pW5va4tqAsMRVFhlF8xRVaDsTlv9rwv-l0UXoU5VSM118bDrFy1ohikE-ciAvA_22QGoa49auni2HnVlLkZMP18HWJL11aWBtCkj789jg3mFo5-fALQghoW1zt8J2EH0YjkDYcQNLbTzj8eC40_H4NoMAIvXSYivlorE Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: f9753d09aeea45378d637bf28536bb7d Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-VolumesActionsTest-844008822 Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 08:58:04.943566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 08:58:04.945090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f9753d09aeea45378d637bf28536bb7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f9753d09aeea45378d637bf28536bb7d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f9753d09aeea45378d637bf28536bb7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f9753d09aeea45378d637bf28536bb7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:58:04.945090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-VolumesActionsTest-844008822 Aug 24 08:58:04.945090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: f9753d09aeea45378d637bf28536bb7d Aug 24 08:58:04.945090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-VolumesActionsTest-844008822 Aug 24 08:58:04.945090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-VolumesActionsTest-844008822-project Aug 24 08:58:04.945090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 08:58:04.945090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 08:58:04.945090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: bb815fa9f45a4b1db1f30fbfaeb3c4c9 Aug 24 08:58:04.945090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-VolumesActionsTest-844008822-project Aug 24 08:58:04.945090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 08:58:04.945090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance ad3157fc-f36b-4f69-afb3-34b4e632b8a5 could not be found. Aug 24 08:58:04.945090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': 'ad3157fc-f36b-4f69-afb3-34b4e632b8a5'} Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3157fc-f36b-4f69-afb3-34b4e632b8a5 could not be found. Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:58:04.946019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3157fc-f36b-4f69-afb3-34b4e632b8a5 could not be found. Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3157fc-f36b-4f69-afb3-34b4e632b8a5 could not be found. Aug 24 08:58:04.947399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:04.948985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-abb35320-962c-4b01-8c90-408f1ff87574 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] Returning 404 to user: Instance ad3157fc-f36b-4f69-afb3-34b4e632b8a5 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:58:04.948985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-abb35320-962c-4b01-8c90-408f1ff87574 tempest-VolumesActionsTest-844008822 tempest-VolumesActionsTest-844008822-project] 10.222.0.55 "GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5" status: 404 len: 111 microversion: 2.1 time: 0.032324 Aug 24 08:58:04.948985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 203/395] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:04 2022] GET /compute/v2.1/servers/ad3157fc-f36b-4f69-afb3-34b4e632b8a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 08:58:05.340694 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2d62a83d-8ff9-4721-b85d-dda906bfe8d8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:05.341794 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2d62a83d-8ff9-4721-b85d-dda906bfe8d8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:05.356350 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2d62a83d-8ff9-4721-b85d-dda906bfe8d8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:05.357027 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2d62a83d-8ff9-4721-b85d-dda906bfe8d8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:05.357575 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2d62a83d-8ff9-4721-b85d-dda906bfe8d8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:05.358415 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2d62a83d-8ff9-4721-b85d-dda906bfe8d8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:05.360009 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2d62a83d-8ff9-4721-b85d-dda906bfe8d8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:05.360009 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2d62a83d-8ff9-4721-b85d-dda906bfe8d8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:05.589771 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-35c93f0b-cc29-446d-bacd-79db679c39a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "POST /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.182312 Aug 24 08:58:05.591644 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 193/396] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 08:58:04 2022] POST /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7/os-volume_attachments => generated 194 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:58:05.629507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2d62a83d-8ff9-4721-b85d-dda906bfe8d8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:05.638288 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2d62a83d-8ff9-4721-b85d-dda906bfe8d8 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.304348 Aug 24 08:58:05.638885 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 204/397] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:05 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:06.677111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5573cfd6-feee-456a-9ec9-e26a83851b5f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:06.677818 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5573cfd6-feee-456a-9ec9-e26a83851b5f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:06.684975 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5573cfd6-feee-456a-9ec9-e26a83851b5f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:06.685459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5573cfd6-feee-456a-9ec9-e26a83851b5f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:06.685887 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5573cfd6-feee-456a-9ec9-e26a83851b5f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:06.686589 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5573cfd6-feee-456a-9ec9-e26a83851b5f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:06.687033 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5573cfd6-feee-456a-9ec9-e26a83851b5f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:06.687451 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5573cfd6-feee-456a-9ec9-e26a83851b5f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:06.847788 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5573cfd6-feee-456a-9ec9-e26a83851b5f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:06.856092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5573cfd6-feee-456a-9ec9-e26a83851b5f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1502 microversion: 2.1 time: 0.183967 Aug 24 08:58:06.856719 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 194/398] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:06 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:06.883156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6f404aa2-9349-48b9-a252-850fb8116e8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8daf8851-fe70-4d1e-a4c1-b47032246651"}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:06.885597 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6f404aa2-9349-48b9-a252-850fb8116e8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:06.892864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6f404aa2-9349-48b9-a252-850fb8116e8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:06.893352 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6f404aa2-9349-48b9-a252-850fb8116e8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:06.893781 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6f404aa2-9349-48b9-a252-850fb8116e8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:06.894486 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6f404aa2-9349-48b9-a252-850fb8116e8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:06.894939 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6f404aa2-9349-48b9-a252-850fb8116e8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:06.895355 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6f404aa2-9349-48b9-a252-850fb8116e8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:06.922324 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-6f404aa2-9349-48b9-a252-850fb8116e8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] HTTP exception thrown: Cannot 'attach_volume' instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 while it is in vm_state rescued Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6f404aa2-9349-48b9-a252-850fb8116e8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Request method failure captured: Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: POST /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57/os-volume_attachments HTTP/1.1 Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 74 Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeVV9ImGTcRNmY4Hiln2vQcRMqL4RxwwQ_WIqLficzvTIx6Pz-RaHxnTth4Y2xKprHubC8bVxL5vpe6TejrqAfQJBa3lTvoqG4hzNbj0JnvBpSGphO-iVUfO5vGv_7r-6agc6A0AMKeemM4c2BBHlfPzWGZS8w3it_iG6hNJDNrWJE Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: c966c27f100846ca8cf06122ddc8c408 Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 08:58:06.924570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 08:58:06.926429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c966c27f100846ca8cf06122ddc8c408", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:58:06.926429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 08:58:06.926429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: c966c27f100846ca8cf06122ddc8c408 Aug 24 08:58:06.926429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 08:58:06.926429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-ServerRescueNegativeTestJSON-509348674-project Aug 24 08:58:06.926429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 08:58:06.926429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 08:58:06.926429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: f56524e822e641bc9bb11eddfe27f85d Aug 24 08:58:06.926429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-ServerRescueNegativeTestJSON-509348674-project Aug 24 08:58:06.926429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Aug 24 08:58:06.926429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {"volumeAttachment": {"volumeId": "8daf8851-fe70-4d1e-a4c1-b47032246651"}} Aug 24 08:58:06.926429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Cannot 'attach_volume' instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 while it is in vm_state rescued Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'server_id': '93e80c6c-b61f-42b6-9c29-cf86c7099e57', 'body': {'volumeAttachment': {'volumeId': '8daf8851-fe70-4d1e-a4c1-b47032246651'}}} Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:58:06.927447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 while it is in vm_state rescued Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:58:06.929338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:58:06.931017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:58:06.931017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:58:06.931017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 while it is in vm_state rescued Aug 24 08:58:06.931017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:06.931017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6f404aa2-9349-48b9-a252-850fb8116e8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Returning 409 to user: Cannot 'attach_volume' instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 while it is in vm_state rescued {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:58:06.931017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6f404aa2-9349-48b9-a252-850fb8116e8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "POST /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047167 Aug 24 08:58:06.931017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 205/399] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 08:58:06 2022] POST /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 08:58:06.935551 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b226e22f-6fd7-4bb5-a5d8-2694f4eac1e9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:06.936090 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b226e22f-6fd7-4bb5-a5d8-2694f4eac1e9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:06.942489 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b226e22f-6fd7-4bb5-a5d8-2694f4eac1e9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:06.942973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b226e22f-6fd7-4bb5-a5d8-2694f4eac1e9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:06.943399 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b226e22f-6fd7-4bb5-a5d8-2694f4eac1e9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:06.944100 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b226e22f-6fd7-4bb5-a5d8-2694f4eac1e9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:06.944570 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b226e22f-6fd7-4bb5-a5d8-2694f4eac1e9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:06.945000 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b226e22f-6fd7-4bb5-a5d8-2694f4eac1e9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:07.241588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b226e22f-6fd7-4bb5-a5d8-2694f4eac1e9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "POST /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57/action" status: 202 len: 0 microversion: 2.1 time: 0.309360 Aug 24 08:58:07.242536 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 195/400] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 08:58:06 2022] POST /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:58:07.252310 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ec9ffb57-4811-4e20-b671-65a4a773fcdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:07.253235 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ec9ffb57-4811-4e20-b671-65a4a773fcdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:07.260993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec9ffb57-4811-4e20-b671-65a4a773fcdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:07.261561 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec9ffb57-4811-4e20-b671-65a4a773fcdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:07.261973 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec9ffb57-4811-4e20-b671-65a4a773fcdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:07.262801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec9ffb57-4811-4e20-b671-65a4a773fcdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:07.263279 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec9ffb57-4811-4e20-b671-65a4a773fcdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:07.263707 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ec9ffb57-4811-4e20-b671-65a4a773fcdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:07.421806 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ec9ffb57-4811-4e20-b671-65a4a773fcdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:07.431302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ec9ffb57-4811-4e20-b671-65a4a773fcdc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1510 microversion: 2.1 time: 0.183856 Aug 24 08:58:07.431890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 206/401] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:07 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:08.455337 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a384e285-dbd7-4360-b439-a20fc9173299 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:08.460473 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a384e285-dbd7-4360-b439-a20fc9173299 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:08.462744 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a384e285-dbd7-4360-b439-a20fc9173299 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:08.463229 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a384e285-dbd7-4360-b439-a20fc9173299 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:08.463657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a384e285-dbd7-4360-b439-a20fc9173299 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:08.464358 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a384e285-dbd7-4360-b439-a20fc9173299 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:08.464839 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a384e285-dbd7-4360-b439-a20fc9173299 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:08.465270 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a384e285-dbd7-4360-b439-a20fc9173299 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:08.646479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a384e285-dbd7-4360-b439-a20fc9173299 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:08.656358 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a384e285-dbd7-4360-b439-a20fc9173299 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1510 microversion: 2.1 time: 0.206345 Aug 24 08:58:08.661171 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 196/402] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:08 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1510 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:09.679199 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-02651e0c-3e04-4375-bc07-5b96d2193b94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:09.679791 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-02651e0c-3e04-4375-bc07-5b96d2193b94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:09.686558 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-02651e0c-3e04-4375-bc07-5b96d2193b94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:09.687037 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-02651e0c-3e04-4375-bc07-5b96d2193b94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:09.687461 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-02651e0c-3e04-4375-bc07-5b96d2193b94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:09.688156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-02651e0c-3e04-4375-bc07-5b96d2193b94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:09.688722 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-02651e0c-3e04-4375-bc07-5b96d2193b94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:09.689149 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-02651e0c-3e04-4375-bc07-5b96d2193b94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:09.835906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-02651e0c-3e04-4375-bc07-5b96d2193b94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:09.843920 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-02651e0c-3e04-4375-bc07-5b96d2193b94 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1510 microversion: 2.1 time: 0.168746 Aug 24 08:58:09.844518 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 207/403] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:09 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:10.867291 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ab7c0828-40f1-48eb-8b7d-5b45daf775a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:10.868418 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ab7c0828-40f1-48eb-8b7d-5b45daf775a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:10.878151 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab7c0828-40f1-48eb-8b7d-5b45daf775a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:10.878641 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab7c0828-40f1-48eb-8b7d-5b45daf775a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:10.879079 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab7c0828-40f1-48eb-8b7d-5b45daf775a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:10.879792 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab7c0828-40f1-48eb-8b7d-5b45daf775a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:10.880260 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab7c0828-40f1-48eb-8b7d-5b45daf775a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:10.880820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab7c0828-40f1-48eb-8b7d-5b45daf775a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:11.023049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ab7c0828-40f1-48eb-8b7d-5b45daf775a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:11.031171 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ab7c0828-40f1-48eb-8b7d-5b45daf775a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1510 microversion: 2.1 time: 0.169754 Aug 24 08:58:11.031729 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 197/404] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:10 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:12.053266 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a415a184-e3f5-4544-ba80-2aec7879135c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:12.053812 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a415a184-e3f5-4544-ba80-2aec7879135c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:12.060657 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a415a184-e3f5-4544-ba80-2aec7879135c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:12.061143 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a415a184-e3f5-4544-ba80-2aec7879135c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:12.061603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a415a184-e3f5-4544-ba80-2aec7879135c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:12.062324 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a415a184-e3f5-4544-ba80-2aec7879135c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:12.062778 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a415a184-e3f5-4544-ba80-2aec7879135c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:12.063205 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a415a184-e3f5-4544-ba80-2aec7879135c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:12.197557 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a415a184-e3f5-4544-ba80-2aec7879135c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:12.205829 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a415a184-e3f5-4544-ba80-2aec7879135c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1510 microversion: 2.1 time: 0.156483 Aug 24 08:58:12.206412 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 208/405] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:12 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:13.226297 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2d5475a2-67a9-43d2-9dfc-e7726a09e952 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:13.226910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2d5475a2-67a9-43d2-9dfc-e7726a09e952 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:13.233743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2d5475a2-67a9-43d2-9dfc-e7726a09e952 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:13.234221 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2d5475a2-67a9-43d2-9dfc-e7726a09e952 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:13.234651 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2d5475a2-67a9-43d2-9dfc-e7726a09e952 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:13.235376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2d5475a2-67a9-43d2-9dfc-e7726a09e952 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:13.235820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2d5475a2-67a9-43d2-9dfc-e7726a09e952 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:13.236232 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2d5475a2-67a9-43d2-9dfc-e7726a09e952 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:13.380880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2d5475a2-67a9-43d2-9dfc-e7726a09e952 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:13.388684 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2d5475a2-67a9-43d2-9dfc-e7726a09e952 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1510 microversion: 2.1 time: 0.166241 Aug 24 08:58:13.389252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 198/406] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:13 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:14.410831 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-62a537d4-5744-48b8-b72b-fb32be447d90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:14.411502 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-62a537d4-5744-48b8-b72b-fb32be447d90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:14.418129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62a537d4-5744-48b8-b72b-fb32be447d90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:14.418604 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62a537d4-5744-48b8-b72b-fb32be447d90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:14.419047 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62a537d4-5744-48b8-b72b-fb32be447d90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:14.419713 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62a537d4-5744-48b8-b72b-fb32be447d90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:14.420170 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62a537d4-5744-48b8-b72b-fb32be447d90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:14.420603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-62a537d4-5744-48b8-b72b-fb32be447d90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:14.567568 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-62a537d4-5744-48b8-b72b-fb32be447d90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:14.575847 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-62a537d4-5744-48b8-b72b-fb32be447d90 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1510 microversion: 2.1 time: 0.169347 Aug 24 08:58:14.576661 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 209/407] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:14 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:15.598296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-71ee437a-3882-43d6-ba24-2d4c286fc24f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:15.599414 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-71ee437a-3882-43d6-ba24-2d4c286fc24f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:15.612161 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-71ee437a-3882-43d6-ba24-2d4c286fc24f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:15.614511 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-71ee437a-3882-43d6-ba24-2d4c286fc24f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:15.619187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-71ee437a-3882-43d6-ba24-2d4c286fc24f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:15.619187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-71ee437a-3882-43d6-ba24-2d4c286fc24f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:15.619187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-71ee437a-3882-43d6-ba24-2d4c286fc24f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:15.619187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-71ee437a-3882-43d6-ba24-2d4c286fc24f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:15.842575 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-71ee437a-3882-43d6-ba24-2d4c286fc24f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:15.859702 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-71ee437a-3882-43d6-ba24-2d4c286fc24f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1510 microversion: 2.1 time: 0.266258 Aug 24 08:58:15.872593 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 199/408] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:15 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:16.900672 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-df57571d-8020-4348-8572-15db1e39cd49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:16.901938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-df57571d-8020-4348-8572-15db1e39cd49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:16.915738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-df57571d-8020-4348-8572-15db1e39cd49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:16.916782 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-df57571d-8020-4348-8572-15db1e39cd49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:16.917566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-df57571d-8020-4348-8572-15db1e39cd49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:16.918910 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-df57571d-8020-4348-8572-15db1e39cd49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:16.919669 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-df57571d-8020-4348-8572-15db1e39cd49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:16.920434 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-df57571d-8020-4348-8572-15db1e39cd49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:17.161752 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-df57571d-8020-4348-8572-15db1e39cd49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:17.176646 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-df57571d-8020-4348-8572-15db1e39cd49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1516 microversion: 2.1 time: 0.285637 Aug 24 08:58:17.177567 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 210/409] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:16 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:25.798174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-de01e38d-8fa7-4548-9a8b-77d8e0e38e93 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Action: 'create', calling method: .version_select at 0x7f16ae4df820>, body: {"keypair": {"name": "tempest-keypair-618136394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmCKxdqxtCG9M0UV0NPr+fWFggMikOd90FYtAxwqF8eevfRT1g7BRQxqY0UV6gyN9ZvVUXiBUiKJZB9vi338igX2lNLjTr+T6t4efjXcwezmFwm8p+Y/BfYcOn16S/ntg=="}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:25.809411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:25.822637 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-de01e38d-8fa7-4548-9a8b-77d8e0e38e93 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Getting quotas for project c966c27f100846ca8cf06122ddc8c408. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:58:25.828333 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-de01e38d-8fa7-4548-9a8b-77d8e0e38e93 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Getting quotas for user f56524e822e641bc9bb11eddfe27f85d and project c966c27f100846ca8cf06122ddc8c408. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:58:25.853396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:25.988012 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-de01e38d-8fa7-4548-9a8b-77d8e0e38e93 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.194446 Aug 24 08:58:25.989513 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 200/410] 10.222.0.55 () {60 vars in 1159 bytes} [Wed Aug 24 08:58:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:58:29.425774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1821307096", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f91305e-a47a-4ee8-9410-ebf6faafeb89"}], "security_groups": [{"name": "tempest-securitygroup--830060014"}], "key_name": "tempest-keypair-618136394", "user_data": "}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:29.434198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=37 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:29.434864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=98 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:29.553234 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.network.neutron [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] validate_networks() for [('1f91305e-a47a-4ee8-9410-ebf6faafeb89', None, None, None, None, None)] {{(pid=132984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:58:30.055722 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Flavor limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:58:30.056289 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Image limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:58:30.057162 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Flavor pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:58:30.057778 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Image pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:58:30.058866 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:58:30.070186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:30.070782 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:30.071330 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:30.072178 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:30.072739 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:30.073293 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:30.093484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Getting quotas for project c966c27f100846ca8cf06122ddc8c408. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:58:30.097956 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Getting quotas for user f56524e822e641bc9bb11eddfe27f85d and project c966c27f100846ca8cf06122ddc8c408. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:58:30.111628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Going to run 1 instances... {{(pid=132984) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:58:30.114360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:58:30.356088 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8844cbb3-7f83-4479-b718-03e895daef0d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.935456 Aug 24 08:58:30.356922 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 211/411] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 08:58:29 2022] POST /compute/v2.1/servers => generated 408 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:58:30.371643 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-85ba1794-e24d-4f90-89d2-b93a3ce833a2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:30.372747 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-85ba1794-e24d-4f90-89d2-b93a3ce833a2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:30.471347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-85ba1794-e24d-4f90-89d2-b93a3ce833a2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:30.480492 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-85ba1794-e24d-4f90-89d2-b93a3ce833a2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1245 microversion: 2.1 time: 0.114718 Aug 24 08:58:30.485233 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 201/412] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:30 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1245 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:31.515246 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-94b38d4e-965c-43ab-bbc6-0b13a47b4c74 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:31.533408 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-94b38d4e-965c-43ab-bbc6-0b13a47b4c74 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:31.608212 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-94b38d4e-965c-43ab-bbc6-0b13a47b4c74 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:31.623581 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-94b38d4e-965c-43ab-bbc6-0b13a47b4c74 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1245 microversion: 2.1 time: 0.112427 Aug 24 08:58:31.626262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 212/413] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:31 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:32.649961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-11c38c72-be56-4ceb-ae73-5239fc2bbbee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:32.651378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-11c38c72-be56-4ceb-ae73-5239fc2bbbee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:32.661311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11c38c72-be56-4ceb-ae73-5239fc2bbbee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:32.662024 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11c38c72-be56-4ceb-ae73-5239fc2bbbee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:32.662809 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11c38c72-be56-4ceb-ae73-5239fc2bbbee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:32.663771 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11c38c72-be56-4ceb-ae73-5239fc2bbbee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:32.665471 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11c38c72-be56-4ceb-ae73-5239fc2bbbee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:32.666096 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11c38c72-be56-4ceb-ae73-5239fc2bbbee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:32.768364 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-11c38c72-be56-4ceb-ae73-5239fc2bbbee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:32.778822 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-11c38c72-be56-4ceb-ae73-5239fc2bbbee tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1241 microversion: 2.1 time: 0.133602 Aug 24 08:58:32.780690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 202/414] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:32 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1241 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:33.813078 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fbdf20c6-2d8a-426e-ac66-9b598984d771 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:33.813078 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fbdf20c6-2d8a-426e-ac66-9b598984d771 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:33.828635 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbdf20c6-2d8a-426e-ac66-9b598984d771 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:33.829933 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbdf20c6-2d8a-426e-ac66-9b598984d771 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:33.831032 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbdf20c6-2d8a-426e-ac66-9b598984d771 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:33.853538 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbdf20c6-2d8a-426e-ac66-9b598984d771 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:33.855149 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbdf20c6-2d8a-426e-ac66-9b598984d771 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:33.856242 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbdf20c6-2d8a-426e-ac66-9b598984d771 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:33.975816 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fbdf20c6-2d8a-426e-ac66-9b598984d771 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:33.991161 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fbdf20c6-2d8a-426e-ac66-9b598984d771 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1297 microversion: 2.1 time: 0.191002 Aug 24 08:58:33.992718 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 213/415] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:33 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1297 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:35.014557 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c49b8f3f-8d0d-46d6-b004-e0ce3f2f36bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:35.015185 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c49b8f3f-8d0d-46d6-b004-e0ce3f2f36bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:35.022163 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c49b8f3f-8d0d-46d6-b004-e0ce3f2f36bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:35.024245 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c49b8f3f-8d0d-46d6-b004-e0ce3f2f36bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:35.024245 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c49b8f3f-8d0d-46d6-b004-e0ce3f2f36bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:35.024245 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c49b8f3f-8d0d-46d6-b004-e0ce3f2f36bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:35.024651 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c49b8f3f-8d0d-46d6-b004-e0ce3f2f36bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:35.024915 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c49b8f3f-8d0d-46d6-b004-e0ce3f2f36bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:35.094415 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c49b8f3f-8d0d-46d6-b004-e0ce3f2f36bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:35.102682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c49b8f3f-8d0d-46d6-b004-e0ce3f2f36bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1305 microversion: 2.1 time: 0.092346 Aug 24 08:58:35.104868 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 203/416] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:35 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:36.127261 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1e5910d4-347f-45dc-b3a2-69ca2fb8d88f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:36.128250 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1e5910d4-347f-45dc-b3a2-69ca2fb8d88f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:36.136903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1e5910d4-347f-45dc-b3a2-69ca2fb8d88f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:36.137602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1e5910d4-347f-45dc-b3a2-69ca2fb8d88f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:36.138289 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1e5910d4-347f-45dc-b3a2-69ca2fb8d88f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:36.139252 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1e5910d4-347f-45dc-b3a2-69ca2fb8d88f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:36.139870 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1e5910d4-347f-45dc-b3a2-69ca2fb8d88f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:36.140845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1e5910d4-347f-45dc-b3a2-69ca2fb8d88f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:36.215436 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1e5910d4-347f-45dc-b3a2-69ca2fb8d88f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:36.226097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1e5910d4-347f-45dc-b3a2-69ca2fb8d88f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1305 microversion: 2.1 time: 0.103944 Aug 24 08:58:36.227115 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 214/417] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:36 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:37.247582 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-68498055-5daf-48fb-bf4d-3ce3d83edcda tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:37.248194 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-68498055-5daf-48fb-bf4d-3ce3d83edcda tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:37.255100 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-68498055-5daf-48fb-bf4d-3ce3d83edcda tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:37.257649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-68498055-5daf-48fb-bf4d-3ce3d83edcda tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:37.257649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-68498055-5daf-48fb-bf4d-3ce3d83edcda tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:37.257649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-68498055-5daf-48fb-bf4d-3ce3d83edcda tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:37.257649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-68498055-5daf-48fb-bf4d-3ce3d83edcda tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:37.258024 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-68498055-5daf-48fb-bf4d-3ce3d83edcda tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:37.322310 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-68498055-5daf-48fb-bf4d-3ce3d83edcda tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:37.331318 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-68498055-5daf-48fb-bf4d-3ce3d83edcda tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1305 microversion: 2.1 time: 0.087791 Aug 24 08:58:37.332075 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 204/418] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:37 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1305 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:38.363734 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-dd2bdfe6-4bd4-48ae-81ea-21b43da4460f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:38.364766 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-dd2bdfe6-4bd4-48ae-81ea-21b43da4460f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:38.372237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dd2bdfe6-4bd4-48ae-81ea-21b43da4460f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:38.372752 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dd2bdfe6-4bd4-48ae-81ea-21b43da4460f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:38.373252 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dd2bdfe6-4bd4-48ae-81ea-21b43da4460f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:38.373988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dd2bdfe6-4bd4-48ae-81ea-21b43da4460f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:38.374436 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dd2bdfe6-4bd4-48ae-81ea-21b43da4460f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:38.375865 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dd2bdfe6-4bd4-48ae-81ea-21b43da4460f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:38.472477 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-dd2bdfe6-4bd4-48ae-81ea-21b43da4460f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:38.494686 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-dd2bdfe6-4bd4-48ae-81ea-21b43da4460f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1315 microversion: 2.1 time: 0.142482 Aug 24 08:58:38.495812 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 215/419] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:38 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:39.544182 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2c825cdc-a8d3-4cad-aaa3-9d8087b6d124 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:39.554149 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2c825cdc-a8d3-4cad-aaa3-9d8087b6d124 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:39.563800 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c825cdc-a8d3-4cad-aaa3-9d8087b6d124 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:39.564963 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c825cdc-a8d3-4cad-aaa3-9d8087b6d124 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:39.566148 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c825cdc-a8d3-4cad-aaa3-9d8087b6d124 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:39.568747 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c825cdc-a8d3-4cad-aaa3-9d8087b6d124 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:39.569800 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c825cdc-a8d3-4cad-aaa3-9d8087b6d124 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:39.570754 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c825cdc-a8d3-4cad-aaa3-9d8087b6d124 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:40.065028 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2c825cdc-a8d3-4cad-aaa3-9d8087b6d124 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:40.085870 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2c825cdc-a8d3-4cad-aaa3-9d8087b6d124 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.554035 Aug 24 08:58:40.092790 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 205/420] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:39 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:40.609256 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-67018295-e33a-4e98-9f80-fc33e944be68 req-16c0ad3e-4b33-4bf2-bf59-938419b84bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2342ef6-1538-4ed8-a880-4592faa068f5", "tag": "24078fe7-6b72-4110-8f91-0468c482387e"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:40.615225 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:40.621409 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-67018295-e33a-4e98-9f80-fc33e944be68 req-16c0ad3e-4b33-4bf2-bf59-938419b84bd4 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:40.621886 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-67018295-e33a-4e98-9f80-fc33e944be68 req-16c0ad3e-4b33-4bf2-bf59-938419b84bd4 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:40.622313 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-67018295-e33a-4e98-9f80-fc33e944be68 req-16c0ad3e-4b33-4bf2-bf59-938419b84bd4 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:40.637599 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-67018295-e33a-4e98-9f80-fc33e944be68 req-16c0ad3e-4b33-4bf2-bf59-938419b84bd4 service nova] Creating event network-changed:24078fe7-6b72-4110-8f91-0468c482387e for instance b2342ef6-1538-4ed8-a880-4592faa068f5 on hv-cinder-85221 Aug 24 08:58:40.644424 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-67018295-e33a-4e98-9f80-fc33e944be68 req-16c0ad3e-4b33-4bf2-bf59-938419b84bd4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040361 Aug 24 08:58:40.645065 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 216/421] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:58:41.116658 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-32486a17-f1a3-44e3-ae3b-9b5052e2c3fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:41.117522 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-32486a17-f1a3-44e3-ae3b-9b5052e2c3fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:41.129360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=6 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:41.131620 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-32486a17-f1a3-44e3-ae3b-9b5052e2c3fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:41.132120 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-32486a17-f1a3-44e3-ae3b-9b5052e2c3fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:41.132602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-32486a17-f1a3-44e3-ae3b-9b5052e2c3fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:41.133314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-32486a17-f1a3-44e3-ae3b-9b5052e2c3fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:41.133944 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-32486a17-f1a3-44e3-ae3b-9b5052e2c3fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:41.134579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-32486a17-f1a3-44e3-ae3b-9b5052e2c3fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:41.563174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-32486a17-f1a3-44e3-ae3b-9b5052e2c3fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:41.575497 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-32486a17-f1a3-44e3-ae3b-9b5052e2c3fb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.464063 Aug 24 08:58:41.585653 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 206/422] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:41 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:42.622590 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-18e868b2-1236-4efa-be23-57732edf0549 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:42.623945 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-18e868b2-1236-4efa-be23-57732edf0549 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:42.628348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=8 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:42.640778 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-18e868b2-1236-4efa-be23-57732edf0549 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:42.641406 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-18e868b2-1236-4efa-be23-57732edf0549 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:42.642314 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-18e868b2-1236-4efa-be23-57732edf0549 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:42.643656 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-18e868b2-1236-4efa-be23-57732edf0549 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:42.644479 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-18e868b2-1236-4efa-be23-57732edf0549 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:42.645274 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-18e868b2-1236-4efa-be23-57732edf0549 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:42.901688 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-18e868b2-1236-4efa-be23-57732edf0549 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:42.909872 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-18e868b2-1236-4efa-be23-57732edf0549 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.300862 Aug 24 08:58:42.910453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 217/423] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:42 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:43.680530 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1f50fa20-bddc-41e5-a3b6-1bb3ee28f318 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:43.681408 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1f50fa20-bddc-41e5-a3b6-1bb3ee28f318 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:43.688450 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f50fa20-bddc-41e5-a3b6-1bb3ee28f318 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:43.688961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f50fa20-bddc-41e5-a3b6-1bb3ee28f318 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:43.689391 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f50fa20-bddc-41e5-a3b6-1bb3ee28f318 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:43.690140 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f50fa20-bddc-41e5-a3b6-1bb3ee28f318 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:43.690590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f50fa20-bddc-41e5-a3b6-1bb3ee28f318 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:43.691007 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f50fa20-bddc-41e5-a3b6-1bb3ee28f318 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:43.862962 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-1f50fa20-bddc-41e5-a3b6-1bb3ee28f318 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lazy-loading 'services' on Instance uuid e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:58:43.932522 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-81d28550-0f19-48f8-b845-4fdd820e255e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:43.934851 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-81d28550-0f19-48f8-b845-4fdd820e255e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:43.945424 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-81d28550-0f19-48f8-b845-4fdd820e255e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:43.946087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-81d28550-0f19-48f8-b845-4fdd820e255e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:43.946603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-81d28550-0f19-48f8-b845-4fdd820e255e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:43.948172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-81d28550-0f19-48f8-b845-4fdd820e255e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:43.948822 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-81d28550-0f19-48f8-b845-4fdd820e255e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:43.949329 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-81d28550-0f19-48f8-b845-4fdd820e255e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:44.216107 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1f50fa20-bddc-41e5-a3b6-1bb3ee28f318 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7/os-volume_attachments/958988cd-7179-4688-8a5c-6271d68eec9b" status: 202 len: 0 microversion: 2.1 time: 0.539715 Aug 24 08:58:44.216889 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 207/424] 10.222.0.55 () {58 vars in 1416 bytes} [Wed Aug 24 08:58:43 2022] DELETE /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7/os-volume_attachments/958988cd-7179-4688-8a5c-6271d68eec9b => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:58:44.250610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-81d28550-0f19-48f8-b845-4fdd820e255e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:44.265636 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-81d28550-0f19-48f8-b845-4fdd820e255e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.336466 Aug 24 08:58:44.267622 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 218/425] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:43 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:45.307664 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4cf1b9d6-7191-48e1-a134-1ea38b025679 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:45.309957 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4cf1b9d6-7191-48e1-a134-1ea38b025679 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:45.323347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4cf1b9d6-7191-48e1-a134-1ea38b025679 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:45.324641 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4cf1b9d6-7191-48e1-a134-1ea38b025679 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:45.325493 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4cf1b9d6-7191-48e1-a134-1ea38b025679 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:45.326852 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4cf1b9d6-7191-48e1-a134-1ea38b025679 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:45.328325 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4cf1b9d6-7191-48e1-a134-1ea38b025679 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:45.329457 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4cf1b9d6-7191-48e1-a134-1ea38b025679 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:45.575581 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4cf1b9d6-7191-48e1-a134-1ea38b025679 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:45.617736 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4cf1b9d6-7191-48e1-a134-1ea38b025679 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.318863 Aug 24 08:58:45.618724 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 208/426] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:45 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:46.652397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3b6dc569-4a9b-4d60-aef8-a822b5946f8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:46.653420 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3b6dc569-4a9b-4d60-aef8-a822b5946f8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:46.662757 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b6dc569-4a9b-4d60-aef8-a822b5946f8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:46.676919 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b6dc569-4a9b-4d60-aef8-a822b5946f8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:46.676919 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b6dc569-4a9b-4d60-aef8-a822b5946f8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:46.676919 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b6dc569-4a9b-4d60-aef8-a822b5946f8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:46.676919 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b6dc569-4a9b-4d60-aef8-a822b5946f8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:46.677453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b6dc569-4a9b-4d60-aef8-a822b5946f8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:46.830186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3b6dc569-4a9b-4d60-aef8-a822b5946f8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:46.839578 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3b6dc569-4a9b-4d60-aef8-a822b5946f8e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.192229 Aug 24 08:58:46.854763 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 219/427] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:46 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:47.862176 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-05c0a52f-48d8-41d3-a6fb-e9fba817f576 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:47.862986 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-05c0a52f-48d8-41d3-a6fb-e9fba817f576 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:47.871414 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05c0a52f-48d8-41d3-a6fb-e9fba817f576 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:47.872379 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05c0a52f-48d8-41d3-a6fb-e9fba817f576 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:47.872961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05c0a52f-48d8-41d3-a6fb-e9fba817f576 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:47.873821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05c0a52f-48d8-41d3-a6fb-e9fba817f576 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:47.874936 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05c0a52f-48d8-41d3-a6fb-e9fba817f576 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:47.875548 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05c0a52f-48d8-41d3-a6fb-e9fba817f576 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:48.035092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-05c0a52f-48d8-41d3-a6fb-e9fba817f576 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:48.043589 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-05c0a52f-48d8-41d3-a6fb-e9fba817f576 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.186176 Aug 24 08:58:48.044163 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 209/428] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:47 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:48.345333 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a99a8e62-c4c4-4175-8df9-c02548132f2d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:48.346356 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a99a8e62-c4c4-4175-8df9-c02548132f2d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:48.368093 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a99a8e62-c4c4-4175-8df9-c02548132f2d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:48.368093 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a99a8e62-c4c4-4175-8df9-c02548132f2d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:48.368093 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a99a8e62-c4c4-4175-8df9-c02548132f2d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:48.368093 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a99a8e62-c4c4-4175-8df9-c02548132f2d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:48.368382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a99a8e62-c4c4-4175-8df9-c02548132f2d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:48.368382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a99a8e62-c4c4-4175-8df9-c02548132f2d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:48.416606 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a99a8e62-c4c4-4175-8df9-c02548132f2d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Going to try to terminate instance {{(pid=132984) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:58:48.890801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a99a8e62-c4c4-4175-8df9-c02548132f2d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 204 len: 0 microversion: 2.1 time: 0.552549 Aug 24 08:58:48.891768 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 220/429] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 08:58:48 2022] DELETE /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:58:48.904500 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d13acbb8-3463-465d-bde9-bec74d1f5517 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:48.906222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d13acbb8-3463-465d-bde9-bec74d1f5517 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:48.915996 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d13acbb8-3463-465d-bde9-bec74d1f5517 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:48.916634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d13acbb8-3463-465d-bde9-bec74d1f5517 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:48.917397 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d13acbb8-3463-465d-bde9-bec74d1f5517 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:48.918617 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d13acbb8-3463-465d-bde9-bec74d1f5517 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:48.919438 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d13acbb8-3463-465d-bde9-bec74d1f5517 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:48.920219 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d13acbb8-3463-465d-bde9-bec74d1f5517 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:49.071940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f16d0896-3aef-4485-9bb8-5de38ae1ef6a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:49.073398 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f16d0896-3aef-4485-9bb8-5de38ae1ef6a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:49.085379 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f16d0896-3aef-4485-9bb8-5de38ae1ef6a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:49.086269 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f16d0896-3aef-4485-9bb8-5de38ae1ef6a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:49.087068 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f16d0896-3aef-4485-9bb8-5de38ae1ef6a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:49.088367 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f16d0896-3aef-4485-9bb8-5de38ae1ef6a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:49.089381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f16d0896-3aef-4485-9bb8-5de38ae1ef6a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:49.090190 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f16d0896-3aef-4485-9bb8-5de38ae1ef6a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:49.090997 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d13acbb8-3463-465d-bde9-bec74d1f5517 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:49.101010 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d13acbb8-3463-465d-bde9-bec74d1f5517 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1514 microversion: 2.1 time: 0.204309 Aug 24 08:58:49.101599 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 210/430] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:48 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:49.264856 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f16d0896-3aef-4485-9bb8-5de38ae1ef6a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:49.273271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f16d0896-3aef-4485-9bb8-5de38ae1ef6a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.209880 Aug 24 08:58:49.273931 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 221/431] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:49 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:49.958287 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-3384ae2a-b70c-4561-9291-22c81cbecd3c req-f6067f5c-7b4d-4fc5-ba69-f4671c894a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2342ef6-1538-4ed8-a880-4592faa068f5", "name": "network-vif-plugged", "status": "completed", "tag": "24078fe7-6b72-4110-8f91-0468c482387e"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:49.976679 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-3384ae2a-b70c-4561-9291-22c81cbecd3c req-f6067f5c-7b4d-4fc5-ba69-f4671c894a58 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:49.977466 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-3384ae2a-b70c-4561-9291-22c81cbecd3c req-f6067f5c-7b4d-4fc5-ba69-f4671c894a58 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:49.978194 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-3384ae2a-b70c-4561-9291-22c81cbecd3c req-f6067f5c-7b4d-4fc5-ba69-f4671c894a58 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:49.993869 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-3384ae2a-b70c-4561-9291-22c81cbecd3c req-f6067f5c-7b4d-4fc5-ba69-f4671c894a58 service nova] Creating event network-vif-plugged:24078fe7-6b72-4110-8f91-0468c482387e for instance b2342ef6-1538-4ed8-a880-4592faa068f5 on hv-cinder-85221 Aug 24 08:58:50.000149 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-3384ae2a-b70c-4561-9291-22c81cbecd3c req-f6067f5c-7b4d-4fc5-ba69-f4671c894a58 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045315 Aug 24 08:58:50.000804 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 211/432] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:58:50.124747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-44343cba-a88f-41e2-a568-cfc8416f2a52 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:50.125519 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-44343cba-a88f-41e2-a568-cfc8416f2a52 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:50.132958 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-44343cba-a88f-41e2-a568-cfc8416f2a52 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:50.133611 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-44343cba-a88f-41e2-a568-cfc8416f2a52 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:50.134209 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-44343cba-a88f-41e2-a568-cfc8416f2a52 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:50.135184 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-44343cba-a88f-41e2-a568-cfc8416f2a52 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:50.135793 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-44343cba-a88f-41e2-a568-cfc8416f2a52 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:50.136503 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-44343cba-a88f-41e2-a568-cfc8416f2a52 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:50.294496 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-87594422-c85e-4afc-b419-59637ada0748 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:50.295155 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-87594422-c85e-4afc-b419-59637ada0748 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:50.304159 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-87594422-c85e-4afc-b419-59637ada0748 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:50.304801 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-87594422-c85e-4afc-b419-59637ada0748 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:50.305408 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-87594422-c85e-4afc-b419-59637ada0748 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:50.306588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-87594422-c85e-4afc-b419-59637ada0748 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:50.306967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-87594422-c85e-4afc-b419-59637ada0748 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:50.307509 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-87594422-c85e-4afc-b419-59637ada0748 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:50.312200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-44343cba-a88f-41e2-a568-cfc8416f2a52 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:50.321156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-44343cba-a88f-41e2-a568-cfc8416f2a52 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1514 microversion: 2.1 time: 0.201024 Aug 24 08:58:50.322363 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 222/433] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:50 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:50.470063 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-87594422-c85e-4afc-b419-59637ada0748 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:50.479705 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-87594422-c85e-4afc-b419-59637ada0748 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.189568 Aug 24 08:58:50.480306 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 212/434] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:50 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:51.349596 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b0ddac29-046d-4074-8f2a-0408320e9fe1 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:51.351749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b0ddac29-046d-4074-8f2a-0408320e9fe1 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:51.363631 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b0ddac29-046d-4074-8f2a-0408320e9fe1 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:51.364501 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b0ddac29-046d-4074-8f2a-0408320e9fe1 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:51.365567 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b0ddac29-046d-4074-8f2a-0408320e9fe1 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:51.368145 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b0ddac29-046d-4074-8f2a-0408320e9fe1 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:51.369301 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b0ddac29-046d-4074-8f2a-0408320e9fe1 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:51.370167 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b0ddac29-046d-4074-8f2a-0408320e9fe1 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:51.515563 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-dc9d0fce-4c66-4c22-a4e6-1fec96570021 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:51.520703 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-dc9d0fce-4c66-4c22-a4e6-1fec96570021 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:51.531554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc9d0fce-4c66-4c22-a4e6-1fec96570021 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:51.532794 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc9d0fce-4c66-4c22-a4e6-1fec96570021 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:51.534047 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc9d0fce-4c66-4c22-a4e6-1fec96570021 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:51.536429 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc9d0fce-4c66-4c22-a4e6-1fec96570021 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:51.537792 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc9d0fce-4c66-4c22-a4e6-1fec96570021 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:51.538969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc9d0fce-4c66-4c22-a4e6-1fec96570021 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:51.745188 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b0ddac29-046d-4074-8f2a-0408320e9fe1 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:51.759711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b0ddac29-046d-4074-8f2a-0408320e9fe1 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1514 microversion: 2.1 time: 0.417615 Aug 24 08:58:51.776957 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 223/435] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:51 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1514 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:51.809061 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-dc9d0fce-4c66-4c22-a4e6-1fec96570021 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:51.816918 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-dc9d0fce-4c66-4c22-a4e6-1fec96570021 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.312075 Aug 24 08:58:51.817509 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 213/436] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:51 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:52.001604 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-c365b52c-c43c-4f3b-bc19-b9c136007390 req-01f4173b-f561-45a8-995c-6de98155a152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e11c5e20-10df-4e90-9cbe-7ca8cdf061d7", "name": "network-vif-deleted", "tag": "32104588-8907-4ad0-b7dd-d6cd37053597"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:52.012816 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-c365b52c-c43c-4f3b-bc19-b9c136007390 req-01f4173b-f561-45a8-995c-6de98155a152 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:52.013293 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-c365b52c-c43c-4f3b-bc19-b9c136007390 req-01f4173b-f561-45a8-995c-6de98155a152 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:52.013723 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-c365b52c-c43c-4f3b-bc19-b9c136007390 req-01f4173b-f561-45a8-995c-6de98155a152 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:52.026472 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-c365b52c-c43c-4f3b-bc19-b9c136007390 req-01f4173b-f561-45a8-995c-6de98155a152 service nova] Creating event network-vif-deleted:32104588-8907-4ad0-b7dd-d6cd37053597 for instance e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 on hv-cinder-85221 Aug 24 08:58:52.032652 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-c365b52c-c43c-4f3b-bc19-b9c136007390 req-01f4173b-f561-45a8-995c-6de98155a152 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035667 Aug 24 08:58:52.033268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 224/437] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:58:52.795306 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1948bd5f-37ef-4adc-ba8b-a5755da9eb6e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:52.796121 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1948bd5f-37ef-4adc-ba8b-a5755da9eb6e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:52.803484 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1948bd5f-37ef-4adc-ba8b-a5755da9eb6e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:52.803971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1948bd5f-37ef-4adc-ba8b-a5755da9eb6e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:52.804407 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1948bd5f-37ef-4adc-ba8b-a5755da9eb6e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:52.805178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1948bd5f-37ef-4adc-ba8b-a5755da9eb6e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:52.805716 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1948bd5f-37ef-4adc-ba8b-a5755da9eb6e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:52.806188 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1948bd5f-37ef-4adc-ba8b-a5755da9eb6e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:52.845828 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-afdc2f4b-0434-4362-93d8-38aeefd01b18 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:52.847043 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-afdc2f4b-0434-4362-93d8-38aeefd01b18 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:52.856902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-afdc2f4b-0434-4362-93d8-38aeefd01b18 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:52.857569 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-afdc2f4b-0434-4362-93d8-38aeefd01b18 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:52.858200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-afdc2f4b-0434-4362-93d8-38aeefd01b18 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:52.860308 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-afdc2f4b-0434-4362-93d8-38aeefd01b18 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:52.861014 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-afdc2f4b-0434-4362-93d8-38aeefd01b18 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:52.861576 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-afdc2f4b-0434-4362-93d8-38aeefd01b18 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:52.989140 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1948bd5f-37ef-4adc-ba8b-a5755da9eb6e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:53.008631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1948bd5f-37ef-4adc-ba8b-a5755da9eb6e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1472 microversion: 2.1 time: 0.217546 Aug 24 08:58:53.009699 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 214/438] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:52 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1472 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:53.066448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-afdc2f4b-0434-4362-93d8-38aeefd01b18 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:53.082307 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-afdc2f4b-0434-4362-93d8-38aeefd01b18 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.245667 Aug 24 08:58:53.083535 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 225/439] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:52 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:54.040503 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8d2d507b-583a-45ce-ab7b-2488cc8295ee tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:54.041155 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8d2d507b-583a-45ce-ab7b-2488cc8295ee tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:54.049437 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8d2d507b-583a-45ce-ab7b-2488cc8295ee tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:54.050000 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8d2d507b-583a-45ce-ab7b-2488cc8295ee tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:54.050479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8d2d507b-583a-45ce-ab7b-2488cc8295ee tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:54.051350 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8d2d507b-583a-45ce-ab7b-2488cc8295ee tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:54.051903 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8d2d507b-583a-45ce-ab7b-2488cc8295ee tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:54.052361 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8d2d507b-583a-45ce-ab7b-2488cc8295ee tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:54.114243 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5178234f-d11a-4fe2-b130-d790c213c18e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:54.115180 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5178234f-d11a-4fe2-b130-d790c213c18e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:54.122310 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5178234f-d11a-4fe2-b130-d790c213c18e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:54.122787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5178234f-d11a-4fe2-b130-d790c213c18e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:54.123214 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8d2d507b-583a-45ce-ab7b-2488cc8295ee tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:54.123422 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5178234f-d11a-4fe2-b130-d790c213c18e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:54.123950 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5178234f-d11a-4fe2-b130-d790c213c18e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:54.124938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5178234f-d11a-4fe2-b130-d790c213c18e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:54.125364 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5178234f-d11a-4fe2-b130-d790c213c18e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:54.133802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8d2d507b-583a-45ce-ab7b-2488cc8295ee tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1472 microversion: 2.1 time: 0.097184 Aug 24 08:58:54.134629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 215/440] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:54 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1472 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:54.274622 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5178234f-d11a-4fe2-b130-d790c213c18e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:54.284528 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5178234f-d11a-4fe2-b130-d790c213c18e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.174393 Aug 24 08:58:54.285136 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 226/441] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:54 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:55.158772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-322ec7cd-6af5-4777-bec9-4ccb13e9fa3d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:55.159901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-322ec7cd-6af5-4777-bec9-4ccb13e9fa3d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:55.170458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-322ec7cd-6af5-4777-bec9-4ccb13e9fa3d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:55.171113 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-322ec7cd-6af5-4777-bec9-4ccb13e9fa3d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:55.171636 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-322ec7cd-6af5-4777-bec9-4ccb13e9fa3d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:55.172439 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-322ec7cd-6af5-4777-bec9-4ccb13e9fa3d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:55.173028 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-322ec7cd-6af5-4777-bec9-4ccb13e9fa3d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:55.173539 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-322ec7cd-6af5-4777-bec9-4ccb13e9fa3d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:55.266389 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-322ec7cd-6af5-4777-bec9-4ccb13e9fa3d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:55.273461 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-322ec7cd-6af5-4777-bec9-4ccb13e9fa3d tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1472 microversion: 2.1 time: 0.119730 Aug 24 08:58:55.274047 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 216/442] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:55 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1472 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:55.314824 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8d5bf93f-a8eb-4e96-98f8-e942f1fdd652 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:55.315459 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8d5bf93f-a8eb-4e96-98f8-e942f1fdd652 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:55.322491 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8d5bf93f-a8eb-4e96-98f8-e942f1fdd652 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:55.322987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8d5bf93f-a8eb-4e96-98f8-e942f1fdd652 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:55.323430 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8d5bf93f-a8eb-4e96-98f8-e942f1fdd652 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:55.324146 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8d5bf93f-a8eb-4e96-98f8-e942f1fdd652 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:55.324647 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8d5bf93f-a8eb-4e96-98f8-e942f1fdd652 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:55.325083 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8d5bf93f-a8eb-4e96-98f8-e942f1fdd652 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:55.478761 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8d5bf93f-a8eb-4e96-98f8-e942f1fdd652 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:55.487567 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8d5bf93f-a8eb-4e96-98f8-e942f1fdd652 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.176647 Aug 24 08:58:55.488159 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 227/443] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:55 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:56.308578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1443b382-d9a8-431c-a9ca-efb0d0fd85b6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:56.309455 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1443b382-d9a8-431c-a9ca-efb0d0fd85b6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:56.317031 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1443b382-d9a8-431c-a9ca-efb0d0fd85b6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:56.317512 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1443b382-d9a8-431c-a9ca-efb0d0fd85b6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:56.317993 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1443b382-d9a8-431c-a9ca-efb0d0fd85b6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:56.319618 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1443b382-d9a8-431c-a9ca-efb0d0fd85b6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:56.320085 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1443b382-d9a8-431c-a9ca-efb0d0fd85b6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:56.320514 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1443b382-d9a8-431c-a9ca-efb0d0fd85b6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:56.389603 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1443b382-d9a8-431c-a9ca-efb0d0fd85b6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:56.402454 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1443b382-d9a8-431c-a9ca-efb0d0fd85b6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1472 microversion: 2.1 time: 0.097747 Aug 24 08:58:56.403257 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 217/444] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:56 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1472 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:56.509714 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3c498739-9625-4845-9674-748dcb7b04c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:56.511371 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3c498739-9625-4845-9674-748dcb7b04c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:56.518841 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c498739-9625-4845-9674-748dcb7b04c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:56.519334 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c498739-9625-4845-9674-748dcb7b04c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:56.519777 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c498739-9625-4845-9674-748dcb7b04c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:56.520719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c498739-9625-4845-9674-748dcb7b04c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:56.521186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c498739-9625-4845-9674-748dcb7b04c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:56.521614 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c498739-9625-4845-9674-748dcb7b04c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:56.729286 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3c498739-9625-4845-9674-748dcb7b04c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:56.733775 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:56.740237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3c498739-9625-4845-9674-748dcb7b04c0 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1370 microversion: 2.1 time: 0.234720 Aug 24 08:58:56.741322 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 228/445] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:56 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:57.438426 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:57.440417 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:57.449693 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:57.450298 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:57.450851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:57.451837 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:57.452308 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:57.452781 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:57.489289 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:57.538041 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:57.539181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:57.540024 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:57.541104 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lazy-loading 'fault' on Instance uuid e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:58:57.612120 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:57.622352 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-31d0e799-fc48-43d9-9c09-889ab1748487 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1308 microversion: 2.1 time: 0.189507 Aug 24 08:58:57.622948 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 218/446] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:57 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:57.770136 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2047d0f2-519c-47cf-ae2e-3527d065054e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:57.772475 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2047d0f2-519c-47cf-ae2e-3527d065054e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:57.791638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2047d0f2-519c-47cf-ae2e-3527d065054e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:57.792917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2047d0f2-519c-47cf-ae2e-3527d065054e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:57.793688 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2047d0f2-519c-47cf-ae2e-3527d065054e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:57.794951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2047d0f2-519c-47cf-ae2e-3527d065054e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:57.796695 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2047d0f2-519c-47cf-ae2e-3527d065054e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:57.797790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2047d0f2-519c-47cf-ae2e-3527d065054e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:58.053111 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2047d0f2-519c-47cf-ae2e-3527d065054e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:58.061462 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2047d0f2-519c-47cf-ae2e-3527d065054e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1565 microversion: 2.1 time: 0.300627 Aug 24 08:58:58.062252 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 229/447] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:57 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1565 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:58.083227 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d491a975-314d-4a9d-ba32-933b7420dd26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:58.083744 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d491a975-314d-4a9d-ba32-933b7420dd26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:58.091065 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d491a975-314d-4a9d-ba32-933b7420dd26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:58.091557 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d491a975-314d-4a9d-ba32-933b7420dd26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:58.091989 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d491a975-314d-4a9d-ba32-933b7420dd26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:58.093227 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d491a975-314d-4a9d-ba32-933b7420dd26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:58.093677 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d491a975-314d-4a9d-ba32-933b7420dd26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:58.094098 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d491a975-314d-4a9d-ba32-933b7420dd26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:58.199003 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d491a975-314d-4a9d-ba32-933b7420dd26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118025 Aug 24 08:58:58.199003 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 219/448] 10.222.0.55 () {58 vars in 1275 bytes} [Wed Aug 24 08:58:58 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:58:58.647896 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:58.649150 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:58.657762 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:58.658407 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:58.658673 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:58.659788 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:58.660247 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:58.660707 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:58.697857 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:58.698354 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:58.698790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:58.699446 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lazy-loading 'fault' on Instance uuid e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:58:58.754801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:58.770810 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-af2699c4-c7d7-4bcf-ac61-fcf7f8bafe29 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 200 len: 1308 microversion: 2.1 time: 0.127072 Aug 24 08:58:58.785212 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 230/449] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:58 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:59.502900 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-d985e620-5126-4bdc-ba3a-106cc0c3356f req-6040f1ee-53ca-4716-908f-987babf732b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2342ef6-1538-4ed8-a880-4592faa068f5", "tag": "24078fe7-6b72-4110-8f91-0468c482387e"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:59.513773 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-d985e620-5126-4bdc-ba3a-106cc0c3356f req-6040f1ee-53ca-4716-908f-987babf732b5 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:59.514276 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-d985e620-5126-4bdc-ba3a-106cc0c3356f req-6040f1ee-53ca-4716-908f-987babf732b5 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:59.515246 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-d985e620-5126-4bdc-ba3a-106cc0c3356f req-6040f1ee-53ca-4716-908f-987babf732b5 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:59.530008 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-d985e620-5126-4bdc-ba3a-106cc0c3356f req-6040f1ee-53ca-4716-908f-987babf732b5 service nova] Creating event network-changed:24078fe7-6b72-4110-8f91-0468c482387e for instance b2342ef6-1538-4ed8-a880-4592faa068f5 on hv-cinder-85221 Aug 24 08:58:59.535388 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-d985e620-5126-4bdc-ba3a-106cc0c3356f req-6040f1ee-53ca-4716-908f-987babf732b5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037308 Aug 24 08:58:59.536195 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 220/450] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:58:59.815559 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7bae6eb8-135e-4232-8a91-f24b603af153 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:59.827092 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7bae6eb8-135e-4232-8a91-f24b603af153 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e11c5e20-10df-4e90-9cbe-7ca8cdf061d7] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:59.827092 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:59.835809 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7bae6eb8-135e-4232-8a91-f24b603af153 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:59.836622 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7bae6eb8-135e-4232-8a91-f24b603af153 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:59.837262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7bae6eb8-135e-4232-8a91-f24b603af153 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:59.838786 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7bae6eb8-135e-4232-8a91-f24b603af153 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:59.839626 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7bae6eb8-135e-4232-8a91-f24b603af153 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:59.840360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7bae6eb8-135e-4232-8a91-f24b603af153 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:59.857562 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-7bae6eb8-135e-4232-8a91-f24b603af153 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] HTTP exception thrown: Instance e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 could not be found. Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7bae6eb8-135e-4232-8a91-f24b603af153 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Request method failure captured: Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 HTTP/1.1 Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBefeULVGsydQljZkJ0aKFSHw5uz5Z0xPs1wbzrL6AvydSqqkVHwwCylCwi-RcLizJ9KWaJgvysv_LwR26BU4OJS1NQpff-4SvAbv8kI2-1E5WZjS3TfWUBte75e6uM4hWWle15mOE4Bic47UAEh2aOnEmi4x0OB8yljrKw-fHBKn1Fw Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: c1977f516dfe40f7b26ffae80d68edd9 Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1406734534 Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 08:58:59.860264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 08:58:59.861745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c1977f516dfe40f7b26ffae80d68edd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c1977f516dfe40f7b26ffae80d68edd9", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c1977f516dfe40f7b26ffae80d68edd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c1977f516dfe40f7b26ffae80d68edd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 08:58:59.861745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-VolumesSnapshotTestJSON-1406734534 Aug 24 08:58:59.861745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: c1977f516dfe40f7b26ffae80d68edd9 Aug 24 08:58:59.861745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1406734534 Aug 24 08:58:59.861745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-VolumesSnapshotTestJSON-1406734534-project Aug 24 08:58:59.861745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 08:58:59.861745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 08:58:59.861745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: c11f1ac1772b46d2a03165571edb6f10 Aug 24 08:58:59.861745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-VolumesSnapshotTestJSON-1406734534-project Aug 24 08:58:59.861745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 08:58:59.861745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 could not be found. Aug 24 08:58:59.861745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': 'e11c5e20-10df-4e90-9cbe-7ca8cdf061d7'} Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 could not be found. Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:58:59.862776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 could not be found. Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 could not be found. Aug 24 08:58:59.864248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 08:58:59.867005 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7bae6eb8-135e-4232-8a91-f24b603af153 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Returning 404 to user: Instance e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:58:59.868081 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7bae6eb8-135e-4232-8a91-f24b603af153 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7" status: 404 len: 111 microversion: 2.1 time: 0.062633 Aug 24 08:58:59.869202 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 231/451] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:59 2022] GET /compute/v2.1/servers/e11c5e20-10df-4e90-9cbe-7ca8cdf061d7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:59:05.149932 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:59:05.150612 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Wed Aug 24 08:59:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:59:14.923218 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:14.924776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=10 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:15.145641 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-552b98d7-5682-4b0f-b26f-76800f908e3a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Action: 'create', calling method: .version_select at 0x7f16ae4d31f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-320820006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISe4BA8Cskwc3vdWYjQpeLa2kyymkvy/TtpEVzOKDP8eeZkwcfDL40HluuQEUNLfF/bojLU0QMnpZ6lMZvrDJOM+cWRGeBKloBu/6qpYqZ8vkkrRFyyaPscJx7Xc47uaQ=="}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:15.162090 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-552b98d7-5682-4b0f-b26f-76800f908e3a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Getting quotas for project 1f01e21018a54220ba1e54c6b7bfc400. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:59:15.166189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-552b98d7-5682-4b0f-b26f-76800f908e3a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Getting quotas for user c2c3752027f342a489e6eb9d3b540819 and project 1f01e21018a54220ba1e54c6b7bfc400. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:59:15.279750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-552b98d7-5682-4b0f-b26f-76800f908e3a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.362873 Aug 24 08:59:15.280377 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 221/452] 10.222.0.55 () {60 vars in 1159 bytes} [Wed Aug 24 08:59:14 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:59:19.419416 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1726693378", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "networks": [{"uuid": "b4172a38-41d9-4fdc-b2fb-3c15555d55f7"}]}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:19.479769 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.network.neutron [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] validate_networks() for [('b4172a38-41d9-4fdc-b2fb-3c15555d55f7', None, None, None, None, None)] {{(pid=132984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:59:19.883321 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Flavor limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:59:19.884292 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Image limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:59:19.884292 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Flavor pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:59:19.884670 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Image pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:59:19.885197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:59:19.898978 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:19.904951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:19.904951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:19.904951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:19.904951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:19.905943 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:19.924486 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Getting quotas for project c1977f516dfe40f7b26ffae80d68edd9. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:59:19.928978 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Getting quotas for user c11f1ac1772b46d2a03165571edb6f10 and project c1977f516dfe40f7b26ffae80d68edd9. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:59:19.941794 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Going to run 1 instances... {{(pid=132984) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:59:19.944094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:59:20.113855 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-dd1f5218-2c04-4763-aa9f-4f8a6bc74f37 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701290 Aug 24 08:59:20.114505 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 232/453] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 08:59:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:59:20.135768 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-de916a88-6247-4e35-8a06-9bcea1d143fa tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:20.137382 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-de916a88-6247-4e35-8a06-9bcea1d143fa tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:20.261120 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-de916a88-6247-4e35-8a06-9bcea1d143fa tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:20.275375 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-de916a88-6247-4e35-8a06-9bcea1d143fa tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1219 microversion: 2.1 time: 0.152027 Aug 24 08:59:20.284136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 222/454] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:20 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:21.302286 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-dab865eb-64b8-49f6-a5a8-d04ec00f7daf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:21.304975 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-dab865eb-64b8-49f6-a5a8-d04ec00f7daf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:21.317897 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dab865eb-64b8-49f6-a5a8-d04ec00f7daf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:21.318691 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dab865eb-64b8-49f6-a5a8-d04ec00f7daf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:21.319414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dab865eb-64b8-49f6-a5a8-d04ec00f7daf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:21.320570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dab865eb-64b8-49f6-a5a8-d04ec00f7daf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:21.321281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dab865eb-64b8-49f6-a5a8-d04ec00f7daf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:21.322206 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dab865eb-64b8-49f6-a5a8-d04ec00f7daf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:21.436265 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-dab865eb-64b8-49f6-a5a8-d04ec00f7daf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:21.453446 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-dab865eb-64b8-49f6-a5a8-d04ec00f7daf tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1223 microversion: 2.1 time: 0.159955 Aug 24 08:59:21.454546 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 233/455] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:21 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1223 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:22.487238 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-eee81467-cef7-403b-a60c-09920a580815 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:22.488015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-eee81467-cef7-403b-a60c-09920a580815 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:22.494605 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-eee81467-cef7-403b-a60c-09920a580815 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:22.495084 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-eee81467-cef7-403b-a60c-09920a580815 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:22.495505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-eee81467-cef7-403b-a60c-09920a580815 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:22.496194 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-eee81467-cef7-403b-a60c-09920a580815 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:22.496713 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-eee81467-cef7-403b-a60c-09920a580815 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:22.497130 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-eee81467-cef7-403b-a60c-09920a580815 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:22.566511 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-eee81467-cef7-403b-a60c-09920a580815 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:22.576640 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-eee81467-cef7-403b-a60c-09920a580815 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1271 microversion: 2.1 time: 0.093243 Aug 24 08:59:22.577272 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 223/456] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:22 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:23.609011 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-88fb2d8a-031a-4b2f-be16-3cd89984e351 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:23.610001 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-88fb2d8a-031a-4b2f-be16-3cd89984e351 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:23.621381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88fb2d8a-031a-4b2f-be16-3cd89984e351 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:23.622245 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88fb2d8a-031a-4b2f-be16-3cd89984e351 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:23.623507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88fb2d8a-031a-4b2f-be16-3cd89984e351 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:23.624941 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88fb2d8a-031a-4b2f-be16-3cd89984e351 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:23.626076 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88fb2d8a-031a-4b2f-be16-3cd89984e351 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:23.627054 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88fb2d8a-031a-4b2f-be16-3cd89984e351 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:23.752195 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-88fb2d8a-031a-4b2f-be16-3cd89984e351 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:23.760906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-88fb2d8a-031a-4b2f-be16-3cd89984e351 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1277 microversion: 2.1 time: 0.159022 Aug 24 08:59:23.761620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 234/457] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:23 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:24.798595 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5dd0fe3f-5e20-4d3b-9d17-0edb6a09d131 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:24.799225 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5dd0fe3f-5e20-4d3b-9d17-0edb6a09d131 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:24.805800 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5dd0fe3f-5e20-4d3b-9d17-0edb6a09d131 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:24.806280 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5dd0fe3f-5e20-4d3b-9d17-0edb6a09d131 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:24.806728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5dd0fe3f-5e20-4d3b-9d17-0edb6a09d131 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:24.807413 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5dd0fe3f-5e20-4d3b-9d17-0edb6a09d131 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:24.807955 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5dd0fe3f-5e20-4d3b-9d17-0edb6a09d131 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:24.808380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5dd0fe3f-5e20-4d3b-9d17-0edb6a09d131 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:24.969696 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5dd0fe3f-5e20-4d3b-9d17-0edb6a09d131 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:24.977855 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5dd0fe3f-5e20-4d3b-9d17-0edb6a09d131 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.187435 Aug 24 08:59:24.978448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 224/458] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:24 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:25.108366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-65d2594b-9ed4-4a25-8fac-65620265c014 req-24c75d8c-b848-46ae-ae97-bc6d1f0635e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5", "tag": "0334fdf9-0a87-442a-a0c9-7fc944c76ef3"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:25.126701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-65d2594b-9ed4-4a25-8fac-65620265c014 req-24c75d8c-b848-46ae-ae97-bc6d1f0635e8 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:25.128880 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-65d2594b-9ed4-4a25-8fac-65620265c014 req-24c75d8c-b848-46ae-ae97-bc6d1f0635e8 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:25.128880 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-65d2594b-9ed4-4a25-8fac-65620265c014 req-24c75d8c-b848-46ae-ae97-bc6d1f0635e8 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:25.143025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-65d2594b-9ed4-4a25-8fac-65620265c014 req-24c75d8c-b848-46ae-ae97-bc6d1f0635e8 service nova] Creating event network-changed:0334fdf9-0a87-442a-a0c9-7fc944c76ef3 for instance e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 on hv-cinder-85221 Aug 24 08:59:25.150133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-65d2594b-9ed4-4a25-8fac-65620265c014 req-24c75d8c-b848-46ae-ae97-bc6d1f0635e8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046032 Aug 24 08:59:25.152979 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 235/459] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:59:26.001574 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-57e9da8b-01b2-411c-928e-750aa77a0a44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:26.002186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-57e9da8b-01b2-411c-928e-750aa77a0a44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:26.020203 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-57e9da8b-01b2-411c-928e-750aa77a0a44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:26.020756 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-57e9da8b-01b2-411c-928e-750aa77a0a44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:26.021196 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-57e9da8b-01b2-411c-928e-750aa77a0a44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:26.021973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-57e9da8b-01b2-411c-928e-750aa77a0a44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:26.022434 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-57e9da8b-01b2-411c-928e-750aa77a0a44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:26.022940 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-57e9da8b-01b2-411c-928e-750aa77a0a44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:26.198308 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-57e9da8b-01b2-411c-928e-750aa77a0a44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:26.214911 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-57e9da8b-01b2-411c-928e-750aa77a0a44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.216789 Aug 24 08:59:26.216070 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 225/460] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:25 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:27.252432 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b5442e0b-8e4f-4afc-854d-c82b1011b3ba tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:27.253218 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b5442e0b-8e4f-4afc-854d-c82b1011b3ba tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:27.259955 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b5442e0b-8e4f-4afc-854d-c82b1011b3ba tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:27.260448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b5442e0b-8e4f-4afc-854d-c82b1011b3ba tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:27.260922 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b5442e0b-8e4f-4afc-854d-c82b1011b3ba tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:27.261624 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b5442e0b-8e4f-4afc-854d-c82b1011b3ba tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:27.262075 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b5442e0b-8e4f-4afc-854d-c82b1011b3ba tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:27.262496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b5442e0b-8e4f-4afc-854d-c82b1011b3ba tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:27.415917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b5442e0b-8e4f-4afc-854d-c82b1011b3ba tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:27.425359 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b5442e0b-8e4f-4afc-854d-c82b1011b3ba tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.177853 Aug 24 08:59:27.425940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 236/461] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:27 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:28.445932 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2270e9bd-fb3c-4b4e-8cb0-cf5cd94388a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:28.446716 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2270e9bd-fb3c-4b4e-8cb0-cf5cd94388a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:28.454197 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2270e9bd-fb3c-4b4e-8cb0-cf5cd94388a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:28.454719 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2270e9bd-fb3c-4b4e-8cb0-cf5cd94388a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:28.455154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2270e9bd-fb3c-4b4e-8cb0-cf5cd94388a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:28.455915 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2270e9bd-fb3c-4b4e-8cb0-cf5cd94388a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:28.456336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2270e9bd-fb3c-4b4e-8cb0-cf5cd94388a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:28.456789 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2270e9bd-fb3c-4b4e-8cb0-cf5cd94388a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:28.605722 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2270e9bd-fb3c-4b4e-8cb0-cf5cd94388a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:28.614394 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2270e9bd-fb3c-4b4e-8cb0-cf5cd94388a6 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.172435 Aug 24 08:59:28.615004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 226/462] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:28 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:59:29.635330 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-673ce87f-f524-4258-b228-2a8d366b7503 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:29.635934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-673ce87f-f524-4258-b228-2a8d366b7503 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:29.650509 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-673ce87f-f524-4258-b228-2a8d366b7503 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:29.650854 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-673ce87f-f524-4258-b228-2a8d366b7503 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:29.651371 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-673ce87f-f524-4258-b228-2a8d366b7503 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:29.652080 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-673ce87f-f524-4258-b228-2a8d366b7503 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:29.652554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-673ce87f-f524-4258-b228-2a8d366b7503 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:29.653023 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-673ce87f-f524-4258-b228-2a8d366b7503 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:29.797450 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-673ce87f-f524-4258-b228-2a8d366b7503 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:29.806496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-673ce87f-f524-4258-b228-2a8d366b7503 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.174798 Aug 24 08:59:29.807279 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 237/463] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:29 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:30.829070 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0357500f-25f4-43f8-bf1c-d7ed9ab604bc tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:30.829707 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0357500f-25f4-43f8-bf1c-d7ed9ab604bc tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:30.832331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=6 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:30.837219 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0357500f-25f4-43f8-bf1c-d7ed9ab604bc tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:30.837688 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0357500f-25f4-43f8-bf1c-d7ed9ab604bc tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:30.838123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0357500f-25f4-43f8-bf1c-d7ed9ab604bc tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:30.838813 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0357500f-25f4-43f8-bf1c-d7ed9ab604bc tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:30.839250 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0357500f-25f4-43f8-bf1c-d7ed9ab604bc tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:30.839668 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0357500f-25f4-43f8-bf1c-d7ed9ab604bc tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:30.988482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0357500f-25f4-43f8-bf1c-d7ed9ab604bc tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:30.996799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0357500f-25f4-43f8-bf1c-d7ed9ab604bc tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.171713 Aug 24 08:59:30.997448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 227/464] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:30 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:59:32.019791 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3ac5befe-b452-4b8a-80f9-129431c6d04a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:32.020892 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3ac5befe-b452-4b8a-80f9-129431c6d04a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:32.022890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:32.023585 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=6 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:32.029840 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ac5befe-b452-4b8a-80f9-129431c6d04a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:32.036710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ac5befe-b452-4b8a-80f9-129431c6d04a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:32.036710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ac5befe-b452-4b8a-80f9-129431c6d04a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:32.036710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ac5befe-b452-4b8a-80f9-129431c6d04a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:32.036710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ac5befe-b452-4b8a-80f9-129431c6d04a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:32.037116 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ac5befe-b452-4b8a-80f9-129431c6d04a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:32.180130 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3ac5befe-b452-4b8a-80f9-129431c6d04a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:32.188422 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3ac5befe-b452-4b8a-80f9-129431c6d04a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.173378 Aug 24 08:59:32.189210 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 238/465] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:32 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:33.211207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-428891cc-85cb-41f9-aefe-123d64a72114 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:33.211848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-428891cc-85cb-41f9-aefe-123d64a72114 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:33.219400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-428891cc-85cb-41f9-aefe-123d64a72114 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:33.219881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-428891cc-85cb-41f9-aefe-123d64a72114 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:33.220312 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-428891cc-85cb-41f9-aefe-123d64a72114 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:33.221091 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-428891cc-85cb-41f9-aefe-123d64a72114 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:33.221518 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-428891cc-85cb-41f9-aefe-123d64a72114 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:33.221932 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-428891cc-85cb-41f9-aefe-123d64a72114 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:33.385202 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-428891cc-85cb-41f9-aefe-123d64a72114 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:33.393406 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-428891cc-85cb-41f9-aefe-123d64a72114 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.186186 Aug 24 08:59:33.393978 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 228/466] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:33 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:34.414680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f0267d5f-0179-487b-be10-2c5d4e65af3e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:34.415317 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f0267d5f-0179-487b-be10-2c5d4e65af3e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:34.423563 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f0267d5f-0179-487b-be10-2c5d4e65af3e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:34.424071 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f0267d5f-0179-487b-be10-2c5d4e65af3e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:34.424509 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f0267d5f-0179-487b-be10-2c5d4e65af3e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:34.425355 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f0267d5f-0179-487b-be10-2c5d4e65af3e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:34.425815 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f0267d5f-0179-487b-be10-2c5d4e65af3e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:34.426386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f0267d5f-0179-487b-be10-2c5d4e65af3e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:34.579947 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f0267d5f-0179-487b-be10-2c5d4e65af3e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:34.591560 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f0267d5f-0179-487b-be10-2c5d4e65af3e tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.179933 Aug 24 08:59:34.592284 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 239/467] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:34 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:35.621192 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-19205101-6607-4383-94e4-d61d491523c7 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:35.622996 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-19205101-6607-4383-94e4-d61d491523c7 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:35.635301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-19205101-6607-4383-94e4-d61d491523c7 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:35.636836 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-19205101-6607-4383-94e4-d61d491523c7 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:35.637668 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-19205101-6607-4383-94e4-d61d491523c7 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:35.639697 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-19205101-6607-4383-94e4-d61d491523c7 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:35.640509 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-19205101-6607-4383-94e4-d61d491523c7 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:35.641436 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-19205101-6607-4383-94e4-d61d491523c7 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:35.842331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-19205101-6607-4383-94e4-d61d491523c7 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:35.868433 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-19205101-6607-4383-94e4-d61d491523c7 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.249899 Aug 24 08:59:35.869312 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 229/468] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:35 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:36.891229 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-33ad3d34-ae40-471f-b57d-4d212dc7c59f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:36.901290 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-33ad3d34-ae40-471f-b57d-4d212dc7c59f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:36.901290 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33ad3d34-ae40-471f-b57d-4d212dc7c59f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:36.901290 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33ad3d34-ae40-471f-b57d-4d212dc7c59f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:36.901290 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33ad3d34-ae40-471f-b57d-4d212dc7c59f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:36.902096 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33ad3d34-ae40-471f-b57d-4d212dc7c59f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:36.902096 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33ad3d34-ae40-471f-b57d-4d212dc7c59f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:36.902096 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33ad3d34-ae40-471f-b57d-4d212dc7c59f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:37.137665 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-33ad3d34-ae40-471f-b57d-4d212dc7c59f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:37.146108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-33ad3d34-ae40-471f-b57d-4d212dc7c59f tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.258908 Aug 24 08:59:37.146690 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 240/469] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:36 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:59:37.612503 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-534b76db-ee51-48c1-91ba-c200cd8fe563 req-d6ca893f-6173-42a0-bd0e-d12255d59aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5", "name": "network-vif-plugged", "status": "completed", "tag": "0334fdf9-0a87-442a-a0c9-7fc944c76ef3"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:37.625895 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-534b76db-ee51-48c1-91ba-c200cd8fe563 req-d6ca893f-6173-42a0-bd0e-d12255d59aac service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:37.626348 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-534b76db-ee51-48c1-91ba-c200cd8fe563 req-d6ca893f-6173-42a0-bd0e-d12255d59aac service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:37.627009 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-534b76db-ee51-48c1-91ba-c200cd8fe563 req-d6ca893f-6173-42a0-bd0e-d12255d59aac service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:37.640699 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-534b76db-ee51-48c1-91ba-c200cd8fe563 req-d6ca893f-6173-42a0-bd0e-d12255d59aac service nova] Creating event network-vif-plugged:0334fdf9-0a87-442a-a0c9-7fc944c76ef3 for instance e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 on hv-cinder-85221 Aug 24 08:59:37.645936 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-534b76db-ee51-48c1-91ba-c200cd8fe563 req-d6ca893f-6173-42a0-bd0e-d12255d59aac service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037274 Aug 24 08:59:37.646588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 230/470] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 08:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:59:38.167868 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d2ff9211-fd0e-4838-ad78-b26b58a6e727 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:38.168605 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d2ff9211-fd0e-4838-ad78-b26b58a6e727 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:38.176265 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d2ff9211-fd0e-4838-ad78-b26b58a6e727 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:38.176824 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d2ff9211-fd0e-4838-ad78-b26b58a6e727 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:38.177272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d2ff9211-fd0e-4838-ad78-b26b58a6e727 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:38.178132 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d2ff9211-fd0e-4838-ad78-b26b58a6e727 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:38.178608 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d2ff9211-fd0e-4838-ad78-b26b58a6e727 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:38.179035 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d2ff9211-fd0e-4838-ad78-b26b58a6e727 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:38.378411 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d2ff9211-fd0e-4838-ad78-b26b58a6e727 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:38.386659 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d2ff9211-fd0e-4838-ad78-b26b58a6e727 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.222747 Aug 24 08:59:38.387229 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 241/471] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:38 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:59:39.412445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4de6c403-a62b-40a1-bdc8-179b23e88103 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:39.413999 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4de6c403-a62b-40a1-bdc8-179b23e88103 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:39.422010 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4de6c403-a62b-40a1-bdc8-179b23e88103 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:39.422485 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4de6c403-a62b-40a1-bdc8-179b23e88103 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:39.422916 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4de6c403-a62b-40a1-bdc8-179b23e88103 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:39.423606 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4de6c403-a62b-40a1-bdc8-179b23e88103 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:39.424053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4de6c403-a62b-40a1-bdc8-179b23e88103 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:39.424462 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4de6c403-a62b-40a1-bdc8-179b23e88103 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:39.568376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4de6c403-a62b-40a1-bdc8-179b23e88103 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:39.576966 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4de6c403-a62b-40a1-bdc8-179b23e88103 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.172520 Aug 24 08:59:39.577796 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 231/472] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:39 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:40.598185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9d4846a9-8498-4e74-8609-bf4bad96c4c3 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:40.598828 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9d4846a9-8498-4e74-8609-bf4bad96c4c3 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:40.605858 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d4846a9-8498-4e74-8609-bf4bad96c4c3 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:40.606849 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d4846a9-8498-4e74-8609-bf4bad96c4c3 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:40.607281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d4846a9-8498-4e74-8609-bf4bad96c4c3 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:40.607981 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d4846a9-8498-4e74-8609-bf4bad96c4c3 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:40.608586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d4846a9-8498-4e74-8609-bf4bad96c4c3 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:40.609083 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d4846a9-8498-4e74-8609-bf4bad96c4c3 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:40.775299 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9d4846a9-8498-4e74-8609-bf4bad96c4c3 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:40.784474 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9d4846a9-8498-4e74-8609-bf4bad96c4c3 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1319 microversion: 2.1 time: 0.190100 Aug 24 08:59:40.785116 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 242/473] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:40 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:41.808343 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-77c07007-c1ce-4789-b8af-087a17176c6a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:41.809042 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-77c07007-c1ce-4789-b8af-087a17176c6a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:41.817657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-77c07007-c1ce-4789-b8af-087a17176c6a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:41.823168 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-77c07007-c1ce-4789-b8af-087a17176c6a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:41.823168 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-77c07007-c1ce-4789-b8af-087a17176c6a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:41.823168 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-77c07007-c1ce-4789-b8af-087a17176c6a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:41.823168 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-77c07007-c1ce-4789-b8af-087a17176c6a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:41.823676 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-77c07007-c1ce-4789-b8af-087a17176c6a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:41.966423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-77c07007-c1ce-4789-b8af-087a17176c6a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:41.974307 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-77c07007-c1ce-4789-b8af-087a17176c6a tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1508 microversion: 2.1 time: 0.170845 Aug 24 08:59:41.974900 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 232/474] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:41 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:41.998330 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0399a4fc-dec7-4e7f-9f7c-e9e90b9aedf0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb9d87b3-a01e-488c-8b6c-7558a8196d1f", "device": "/dev/sdb"}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:42.001489 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0399a4fc-dec7-4e7f-9f7c-e9e90b9aedf0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:42.008454 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0399a4fc-dec7-4e7f-9f7c-e9e90b9aedf0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:42.008881 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0399a4fc-dec7-4e7f-9f7c-e9e90b9aedf0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:42.009319 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0399a4fc-dec7-4e7f-9f7c-e9e90b9aedf0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:42.010041 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0399a4fc-dec7-4e7f-9f7c-e9e90b9aedf0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:42.010471 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0399a4fc-dec7-4e7f-9f7c-e9e90b9aedf0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:42.010929 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0399a4fc-dec7-4e7f-9f7c-e9e90b9aedf0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:43.047725 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0399a4fc-dec7-4e7f-9f7c-e9e90b9aedf0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "POST /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.053544 Aug 24 08:59:43.048681 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 243/475] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 08:59:41 2022] POST /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5/os-volume_attachments => generated 194 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:59:43.526462 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-41ef896b-8ceb-464b-910a-4c39a20e7fcb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:43.527081 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-41ef896b-8ceb-464b-910a-4c39a20e7fcb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:43.538056 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-41ef896b-8ceb-464b-910a-4c39a20e7fcb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:43.539117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-41ef896b-8ceb-464b-910a-4c39a20e7fcb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:43.540082 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-41ef896b-8ceb-464b-910a-4c39a20e7fcb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:43.542156 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-41ef896b-8ceb-464b-910a-4c39a20e7fcb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:43.543108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-41ef896b-8ceb-464b-910a-4c39a20e7fcb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:43.544013 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-41ef896b-8ceb-464b-910a-4c39a20e7fcb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:43.573340 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-41ef896b-8ceb-464b-910a-4c39a20e7fcb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/ips" status: 200 len: 152 microversion: 2.20 time: 0.050762 Aug 24 08:59:43.573924 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 233/476] 10.222.0.55 () {60 vars in 1289 bytes} [Wed Aug 24 08:59:43 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/ips => generated 152 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:59:43.700815 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-36a18b69-6128-4ee1-b9c8-8d2deccb9e34 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:43.701424 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-36a18b69-6128-4ee1-b9c8-8d2deccb9e34 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:43.708476 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-36a18b69-6128-4ee1-b9c8-8d2deccb9e34 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:43.709986 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-36a18b69-6128-4ee1-b9c8-8d2deccb9e34 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:43.711139 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-36a18b69-6128-4ee1-b9c8-8d2deccb9e34 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:43.712065 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-36a18b69-6128-4ee1-b9c8-8d2deccb9e34 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:43.712775 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-36a18b69-6128-4ee1-b9c8-8d2deccb9e34 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:43.713234 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-36a18b69-6128-4ee1-b9c8-8d2deccb9e34 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:43.740790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-36a18b69-6128-4ee1-b9c8-8d2deccb9e34 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/ips" status: 200 len: 150 microversion: 2.1 time: 0.045288 Aug 24 08:59:43.741743 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 244/477] 10.222.0.55 () {58 vars in 1248 bytes} [Wed Aug 24 08:59:43 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:59:47.595405 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ff8f4545-6937-43ea-a1a2-648295786a6b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:47.596047 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ff8f4545-6937-43ea-a1a2-648295786a6b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:47.598637 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:47.603634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ff8f4545-6937-43ea-a1a2-648295786a6b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:47.604117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ff8f4545-6937-43ea-a1a2-648295786a6b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:47.604567 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ff8f4545-6937-43ea-a1a2-648295786a6b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:47.612758 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ff8f4545-6937-43ea-a1a2-648295786a6b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:47.612758 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ff8f4545-6937-43ea-a1a2-648295786a6b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:47.612758 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ff8f4545-6937-43ea-a1a2-648295786a6b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:47.612758 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=61 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:47.632964 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-ff8f4545-6937-43ea-a1a2-648295786a6b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lazy-loading 'flavor' on Instance uuid abdb5828-315b-4046-9985-95e58a2f24b3 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:59:48.144913 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ff8f4545-6937-43ea-a1a2-648295786a6b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "POST /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/action" status: 202 len: 0 microversion: 2.20 time: 0.553207 Aug 24 08:59:48.145514 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 234/478] 10.222.0.55 () {62 vars in 1319 bytes} [Wed Aug 24 08:59:47 2022] POST /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:59:48.154296 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4988346e-b82e-42c5-977b-f99734361732 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:48.155155 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4988346e-b82e-42c5-977b-f99734361732 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:48.162569 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4988346e-b82e-42c5-977b-f99734361732 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:48.163403 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4988346e-b82e-42c5-977b-f99734361732 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:48.164011 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4988346e-b82e-42c5-977b-f99734361732 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:48.165019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4988346e-b82e-42c5-977b-f99734361732 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:48.165701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4988346e-b82e-42c5-977b-f99734361732 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:48.166157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4988346e-b82e-42c5-977b-f99734361732 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:48.309482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4988346e-b82e-42c5-977b-f99734361732 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:48.318090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4988346e-b82e-42c5-977b-f99734361732 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:48.319659 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4988346e-b82e-42c5-977b-f99734361732 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:48.321000 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4988346e-b82e-42c5-977b-f99734361732 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.171091 Aug 24 08:59:48.321564 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 245/479] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:48 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:59:49.348099 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fe841852-089b-4523-954f-abcc0a93e659 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:49.348914 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-fe841852-089b-4523-954f-abcc0a93e659 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:49.356138 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fe841852-089b-4523-954f-abcc0a93e659 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:49.356702 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fe841852-089b-4523-954f-abcc0a93e659 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:49.357177 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fe841852-089b-4523-954f-abcc0a93e659 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:49.357912 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fe841852-089b-4523-954f-abcc0a93e659 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:49.358428 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fe841852-089b-4523-954f-abcc0a93e659 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:49.358855 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fe841852-089b-4523-954f-abcc0a93e659 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:49.484420 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5382d0ef-6ece-41a2-835d-7eb538bad992 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fdeb280-99e1-4444-ba43-36b195baf503"}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:49.487490 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5382d0ef-6ece-41a2-835d-7eb538bad992 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:49.494338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5382d0ef-6ece-41a2-835d-7eb538bad992 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:49.494841 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5382d0ef-6ece-41a2-835d-7eb538bad992 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:49.495451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5382d0ef-6ece-41a2-835d-7eb538bad992 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:49.496191 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5382d0ef-6ece-41a2-835d-7eb538bad992 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:49.496678 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5382d0ef-6ece-41a2-835d-7eb538bad992 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:49.497105 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5382d0ef-6ece-41a2-835d-7eb538bad992 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:49.499979 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:49.514213 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fe841852-089b-4523-954f-abcc0a93e659 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:49.524148 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fe841852-089b-4523-954f-abcc0a93e659 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:49.525766 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fe841852-089b-4523-954f-abcc0a93e659 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:49.527050 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fe841852-089b-4523-954f-abcc0a93e659 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.184251 Aug 24 08:59:49.528643 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 235/480] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:49 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:59:50.341841 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5382d0ef-6ece-41a2-835d-7eb538bad992 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "POST /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.863839 Aug 24 08:59:50.342914 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 246/481] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 08:59:49 2022] POST /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/os-volume_attachments => generated 194 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:59:50.344442 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-bcf6ee9f-389e-495f-a5ff-265ea4b1e9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:50.345140 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-bcf6ee9f-389e-495f-a5ff-265ea4b1e9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:50.352668 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bcf6ee9f-389e-495f-a5ff-265ea4b1e9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:50.353300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bcf6ee9f-389e-495f-a5ff-265ea4b1e9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:50.353799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bcf6ee9f-389e-495f-a5ff-265ea4b1e9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:50.354320 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bcf6ee9f-389e-495f-a5ff-265ea4b1e9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:50.354939 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bcf6ee9f-389e-495f-a5ff-265ea4b1e9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:50.355366 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bcf6ee9f-389e-495f-a5ff-265ea4b1e9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:50.382225 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-bcf6ee9f-389e-495f-a5ff-265ea4b1e9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/ips" status: 200 len: 144 microversion: 2.1 time: 0.042434 Aug 24 08:59:50.382815 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 236/482] 10.222.0.55 () {58 vars in 1248 bytes} [Wed Aug 24 08:59:50 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/ips => generated 144 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:59:50.552251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f682e80b-618a-436b-90ff-bf40fb80aab4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:50.552952 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f682e80b-618a-436b-90ff-bf40fb80aab4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:50.555087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:50.560615 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f682e80b-618a-436b-90ff-bf40fb80aab4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:50.561102 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f682e80b-618a-436b-90ff-bf40fb80aab4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:50.561555 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f682e80b-618a-436b-90ff-bf40fb80aab4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:50.562230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f682e80b-618a-436b-90ff-bf40fb80aab4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:50.562680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f682e80b-618a-436b-90ff-bf40fb80aab4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:50.563099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f682e80b-618a-436b-90ff-bf40fb80aab4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:50.709018 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f682e80b-618a-436b-90ff-bf40fb80aab4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:50.718436 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f682e80b-618a-436b-90ff-bf40fb80aab4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:50.719953 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f682e80b-618a-436b-90ff-bf40fb80aab4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:50.721177 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f682e80b-618a-436b-90ff-bf40fb80aab4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.173281 Aug 24 08:59:50.721744 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 247/483] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:50 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:59:51.746991 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-79835247-d43e-498b-b9a3-7f37172c54f0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:51.747570 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-79835247-d43e-498b-b9a3-7f37172c54f0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:51.754191 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-79835247-d43e-498b-b9a3-7f37172c54f0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:51.754834 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-79835247-d43e-498b-b9a3-7f37172c54f0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:51.755087 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-79835247-d43e-498b-b9a3-7f37172c54f0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:51.755774 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-79835247-d43e-498b-b9a3-7f37172c54f0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:51.756223 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-79835247-d43e-498b-b9a3-7f37172c54f0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:51.756682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-79835247-d43e-498b-b9a3-7f37172c54f0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:51.891374 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-79835247-d43e-498b-b9a3-7f37172c54f0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:51.900128 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-79835247-d43e-498b-b9a3-7f37172c54f0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:51.901660 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-79835247-d43e-498b-b9a3-7f37172c54f0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:51.903442 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-79835247-d43e-498b-b9a3-7f37172c54f0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.161612 Aug 24 08:59:51.904034 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 237/484] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:51 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:59:52.929733 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f951fe95-e6c5-4a03-a910-056e91fd3e94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:52.930342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f951fe95-e6c5-4a03-a910-056e91fd3e94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:52.937225 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f951fe95-e6c5-4a03-a910-056e91fd3e94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:52.937715 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f951fe95-e6c5-4a03-a910-056e91fd3e94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:52.938158 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f951fe95-e6c5-4a03-a910-056e91fd3e94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:52.938861 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f951fe95-e6c5-4a03-a910-056e91fd3e94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:52.939314 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f951fe95-e6c5-4a03-a910-056e91fd3e94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:52.939737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f951fe95-e6c5-4a03-a910-056e91fd3e94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:53.077604 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f951fe95-e6c5-4a03-a910-056e91fd3e94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:53.085931 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f951fe95-e6c5-4a03-a910-056e91fd3e94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:53.087470 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f951fe95-e6c5-4a03-a910-056e91fd3e94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:53.088671 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f951fe95-e6c5-4a03-a910-056e91fd3e94 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.164321 Aug 24 08:59:53.089228 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 248/485] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:52 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:59:54.112513 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1f97ac99-3b93-4474-a4eb-ee0fb3fd8ac0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:54.113119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1f97ac99-3b93-4474-a4eb-ee0fb3fd8ac0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:54.119485 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f97ac99-3b93-4474-a4eb-ee0fb3fd8ac0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:54.119962 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f97ac99-3b93-4474-a4eb-ee0fb3fd8ac0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:54.120392 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f97ac99-3b93-4474-a4eb-ee0fb3fd8ac0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:54.121105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f97ac99-3b93-4474-a4eb-ee0fb3fd8ac0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:54.122221 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f97ac99-3b93-4474-a4eb-ee0fb3fd8ac0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:54.122633 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f97ac99-3b93-4474-a4eb-ee0fb3fd8ac0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:54.260529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1f97ac99-3b93-4474-a4eb-ee0fb3fd8ac0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:54.269774 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1f97ac99-3b93-4474-a4eb-ee0fb3fd8ac0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:54.271313 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1f97ac99-3b93-4474-a4eb-ee0fb3fd8ac0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:54.284731 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1f97ac99-3b93-4474-a4eb-ee0fb3fd8ac0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.163875 Aug 24 08:59:54.284731 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 238/486] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:54 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:59:55.298330 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c146b621-0fee-4260-9382-0d1e090d7e17 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:55.298934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c146b621-0fee-4260-9382-0d1e090d7e17 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:55.305448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c146b621-0fee-4260-9382-0d1e090d7e17 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:55.305937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c146b621-0fee-4260-9382-0d1e090d7e17 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:55.306370 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c146b621-0fee-4260-9382-0d1e090d7e17 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:55.307077 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c146b621-0fee-4260-9382-0d1e090d7e17 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:55.307525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c146b621-0fee-4260-9382-0d1e090d7e17 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:55.307945 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c146b621-0fee-4260-9382-0d1e090d7e17 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:55.450891 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c146b621-0fee-4260-9382-0d1e090d7e17 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:55.459295 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c146b621-0fee-4260-9382-0d1e090d7e17 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:55.460839 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c146b621-0fee-4260-9382-0d1e090d7e17 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:55.461989 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c146b621-0fee-4260-9382-0d1e090d7e17 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.167511 Aug 24 08:59:55.462536 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 249/487] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:55 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:59:56.395914 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ee3de08f-4b8a-4128-a068-871998607db5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8168585d-62ca-4a1e-abe7-e62fd3a878dd"}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:56.398295 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ee3de08f-4b8a-4128-a068-871998607db5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:56.408100 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ee3de08f-4b8a-4128-a068-871998607db5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:56.408604 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ee3de08f-4b8a-4128-a068-871998607db5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:56.409049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ee3de08f-4b8a-4128-a068-871998607db5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:56.409753 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ee3de08f-4b8a-4128-a068-871998607db5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:56.410357 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ee3de08f-4b8a-4128-a068-871998607db5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:56.410778 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ee3de08f-4b8a-4128-a068-871998607db5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:56.485762 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-78b66576-ebd7-4f16-9d10-f75d2e4dbcb4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:56.486411 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-78b66576-ebd7-4f16-9d10-f75d2e4dbcb4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:56.492782 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-78b66576-ebd7-4f16-9d10-f75d2e4dbcb4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:56.493265 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-78b66576-ebd7-4f16-9d10-f75d2e4dbcb4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:56.493826 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-78b66576-ebd7-4f16-9d10-f75d2e4dbcb4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:56.494596 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-78b66576-ebd7-4f16-9d10-f75d2e4dbcb4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:56.495043 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-78b66576-ebd7-4f16-9d10-f75d2e4dbcb4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:56.495463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-78b66576-ebd7-4f16-9d10-f75d2e4dbcb4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:56.630042 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-78b66576-ebd7-4f16-9d10-f75d2e4dbcb4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:56.638168 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-78b66576-ebd7-4f16-9d10-f75d2e4dbcb4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:56.639650 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-78b66576-ebd7-4f16-9d10-f75d2e4dbcb4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:56.640813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-78b66576-ebd7-4f16-9d10-f75d2e4dbcb4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.159813 Aug 24 08:59:56.641373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 250/488] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:56 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:59:57.665059 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-07ca18f9-bc21-4631-af99-6a7fe6d625d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:57.665763 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-07ca18f9-bc21-4631-af99-6a7fe6d625d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:57.672261 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-07ca18f9-bc21-4631-af99-6a7fe6d625d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:57.672778 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-07ca18f9-bc21-4631-af99-6a7fe6d625d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:57.673211 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-07ca18f9-bc21-4631-af99-6a7fe6d625d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:57.673907 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-07ca18f9-bc21-4631-af99-6a7fe6d625d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:57.674357 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-07ca18f9-bc21-4631-af99-6a7fe6d625d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:57.674773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-07ca18f9-bc21-4631-af99-6a7fe6d625d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:57.802995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-07ca18f9-bc21-4631-af99-6a7fe6d625d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:57.811066 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-07ca18f9-bc21-4631-af99-6a7fe6d625d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:57.812579 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-07ca18f9-bc21-4631-af99-6a7fe6d625d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:57.813722 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-07ca18f9-bc21-4631-af99-6a7fe6d625d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.152614 Aug 24 08:59:57.814276 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 251/489] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:57 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:59:58.837654 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fde56806-2553-4a52-855a-5fbffa4c87ec tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:58.838349 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fde56806-2553-4a52-855a-5fbffa4c87ec tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:58.844924 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fde56806-2553-4a52-855a-5fbffa4c87ec tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:58.845412 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fde56806-2553-4a52-855a-5fbffa4c87ec tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:58.845853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fde56806-2553-4a52-855a-5fbffa4c87ec tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:58.846549 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fde56806-2553-4a52-855a-5fbffa4c87ec tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:58.846999 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fde56806-2553-4a52-855a-5fbffa4c87ec tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:58.847424 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fde56806-2553-4a52-855a-5fbffa4c87ec tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:58.989202 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fde56806-2553-4a52-855a-5fbffa4c87ec tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:58.999186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fde56806-2553-4a52-855a-5fbffa4c87ec tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:59.000807 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fde56806-2553-4a52-855a-5fbffa4c87ec tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:59.002187 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fde56806-2553-4a52-855a-5fbffa4c87ec tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.168565 Aug 24 08:59:59.002883 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 252/490] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:58 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:00.028943 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a4c1ece1-a504-4b95-8329-9aa708b48448 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:00.029847 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a4c1ece1-a504-4b95-8329-9aa708b48448 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:00.036792 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a4c1ece1-a504-4b95-8329-9aa708b48448 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:00.037597 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a4c1ece1-a504-4b95-8329-9aa708b48448 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:00.038280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a4c1ece1-a504-4b95-8329-9aa708b48448 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:00.039022 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a4c1ece1-a504-4b95-8329-9aa708b48448 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:00.039475 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a4c1ece1-a504-4b95-8329-9aa708b48448 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:00.039894 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a4c1ece1-a504-4b95-8329-9aa708b48448 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:00.167708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a4c1ece1-a504-4b95-8329-9aa708b48448 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:00.175794 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a4c1ece1-a504-4b95-8329-9aa708b48448 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:00.177358 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a4c1ece1-a504-4b95-8329-9aa708b48448 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:00.178493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a4c1ece1-a504-4b95-8329-9aa708b48448 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.154189 Aug 24 09:00:00.179044 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 253/491] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:00 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:01.190161 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ee3de08f-4b8a-4128-a068-871998607db5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "POST /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.798265 Aug 24 09:00:01.190821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 239/492] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 08:59:56 2022] POST /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/os-volume_attachments => generated 194 bytes in 4800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:00:01.210657 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-60c9f631-da58-42d5-ace8-418ea3ff69e5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:01.211397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-60c9f631-da58-42d5-ace8-418ea3ff69e5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:01.218088 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60c9f631-da58-42d5-ace8-418ea3ff69e5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:01.218571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60c9f631-da58-42d5-ace8-418ea3ff69e5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:01.219001 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60c9f631-da58-42d5-ace8-418ea3ff69e5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:01.219796 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60c9f631-da58-42d5-ace8-418ea3ff69e5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:01.225296 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60c9f631-da58-42d5-ace8-418ea3ff69e5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:01.227023 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60c9f631-da58-42d5-ace8-418ea3ff69e5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:01.358267 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-60c9f631-da58-42d5-ace8-418ea3ff69e5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:01.366428 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-60c9f631-da58-42d5-ace8-418ea3ff69e5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:01.367930 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-60c9f631-da58-42d5-ace8-418ea3ff69e5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:01.369143 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-60c9f631-da58-42d5-ace8-418ea3ff69e5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.163508 Aug 24 09:00:01.369692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 254/493] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:01 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:02.393027 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b0c437b9-341e-431d-ae28-fb05ddada072 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:02.393865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b0c437b9-341e-431d-ae28-fb05ddada072 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:02.400667 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0c437b9-341e-431d-ae28-fb05ddada072 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:02.401158 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0c437b9-341e-431d-ae28-fb05ddada072 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:02.401596 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0c437b9-341e-431d-ae28-fb05ddada072 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:02.402827 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0c437b9-341e-431d-ae28-fb05ddada072 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:02.403282 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0c437b9-341e-431d-ae28-fb05ddada072 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:02.403706 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0c437b9-341e-431d-ae28-fb05ddada072 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:02.542360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b0c437b9-341e-431d-ae28-fb05ddada072 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:02.551240 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b0c437b9-341e-431d-ae28-fb05ddada072 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:02.552816 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b0c437b9-341e-431d-ae28-fb05ddada072 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:02.553982 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b0c437b9-341e-431d-ae28-fb05ddada072 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.165357 Aug 24 09:00:02.554538 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 240/494] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:02 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:03.579543 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9f68a837-70a2-47da-b750-6609987141bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:03.580122 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9f68a837-70a2-47da-b750-6609987141bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:03.586982 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9f68a837-70a2-47da-b750-6609987141bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:03.587475 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9f68a837-70a2-47da-b750-6609987141bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:03.587908 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9f68a837-70a2-47da-b750-6609987141bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:03.588862 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9f68a837-70a2-47da-b750-6609987141bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:03.589374 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9f68a837-70a2-47da-b750-6609987141bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:03.589914 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9f68a837-70a2-47da-b750-6609987141bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:03.729978 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9f68a837-70a2-47da-b750-6609987141bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:03.739259 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9f68a837-70a2-47da-b750-6609987141bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:03.740771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9f68a837-70a2-47da-b750-6609987141bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:03.742041 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9f68a837-70a2-47da-b750-6609987141bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.166676 Aug 24 09:00:03.742882 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 255/495] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:03 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:04.766557 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b063a38a-c2eb-4120-84fd-21eb02417db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:04.767140 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b063a38a-c2eb-4120-84fd-21eb02417db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:04.773558 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b063a38a-c2eb-4120-84fd-21eb02417db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:04.774029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b063a38a-c2eb-4120-84fd-21eb02417db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:04.774478 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b063a38a-c2eb-4120-84fd-21eb02417db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:04.775161 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b063a38a-c2eb-4120-84fd-21eb02417db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:04.775603 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b063a38a-c2eb-4120-84fd-21eb02417db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:04.776013 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b063a38a-c2eb-4120-84fd-21eb02417db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:04.910317 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b063a38a-c2eb-4120-84fd-21eb02417db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:04.917598 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b063a38a-c2eb-4120-84fd-21eb02417db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:04.919113 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b063a38a-c2eb-4120-84fd-21eb02417db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:04.920263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b063a38a-c2eb-4120-84fd-21eb02417db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.157584 Aug 24 09:00:04.920860 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 241/496] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:04 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:05.944384 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f3f59dcb-18be-46fd-a46f-88f4b09b800a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:05.945087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f3f59dcb-18be-46fd-a46f-88f4b09b800a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:05.952262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3f59dcb-18be-46fd-a46f-88f4b09b800a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:05.952774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3f59dcb-18be-46fd-a46f-88f4b09b800a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:05.953207 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3f59dcb-18be-46fd-a46f-88f4b09b800a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:05.953912 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3f59dcb-18be-46fd-a46f-88f4b09b800a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:05.954354 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3f59dcb-18be-46fd-a46f-88f4b09b800a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:05.954778 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3f59dcb-18be-46fd-a46f-88f4b09b800a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:06.097604 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f3f59dcb-18be-46fd-a46f-88f4b09b800a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:06.106400 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f3f59dcb-18be-46fd-a46f-88f4b09b800a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:06.107957 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f3f59dcb-18be-46fd-a46f-88f4b09b800a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:06.109180 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f3f59dcb-18be-46fd-a46f-88f4b09b800a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.168903 Aug 24 09:00:06.109744 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 256/497] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:05 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:07.133033 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f8725ee2-c8ff-46f8-8a08-9befeebb379e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:07.133675 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f8725ee2-c8ff-46f8-8a08-9befeebb379e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:07.140680 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8725ee2-c8ff-46f8-8a08-9befeebb379e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:07.141157 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8725ee2-c8ff-46f8-8a08-9befeebb379e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:07.141583 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8725ee2-c8ff-46f8-8a08-9befeebb379e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:07.142272 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8725ee2-c8ff-46f8-8a08-9befeebb379e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:07.142715 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8725ee2-c8ff-46f8-8a08-9befeebb379e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:07.143129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8725ee2-c8ff-46f8-8a08-9befeebb379e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:07.282778 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f8725ee2-c8ff-46f8-8a08-9befeebb379e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:07.291378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f8725ee2-c8ff-46f8-8a08-9befeebb379e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:07.293398 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f8725ee2-c8ff-46f8-8a08-9befeebb379e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:07.294587 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f8725ee2-c8ff-46f8-8a08-9befeebb379e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.165429 Aug 24 09:00:07.295158 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 242/498] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:07 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:08.318578 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0123c023-78f7-4f12-b2b3-698658ae02f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:08.319193 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0123c023-78f7-4f12-b2b3-698658ae02f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:08.326343 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0123c023-78f7-4f12-b2b3-698658ae02f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:08.326827 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0123c023-78f7-4f12-b2b3-698658ae02f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:08.327287 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0123c023-78f7-4f12-b2b3-698658ae02f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:08.327991 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0123c023-78f7-4f12-b2b3-698658ae02f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:08.328440 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0123c023-78f7-4f12-b2b3-698658ae02f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:08.328890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0123c023-78f7-4f12-b2b3-698658ae02f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:08.516242 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0123c023-78f7-4f12-b2b3-698658ae02f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:08.526126 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0123c023-78f7-4f12-b2b3-698658ae02f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:08.528293 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0123c023-78f7-4f12-b2b3-698658ae02f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:08.529533 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0123c023-78f7-4f12-b2b3-698658ae02f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.214995 Aug 24 09:00:08.530348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 257/499] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:08 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:09.554952 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ae618a90-ee5f-4a36-90c8-bbd765a95dd9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:09.555711 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ae618a90-ee5f-4a36-90c8-bbd765a95dd9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:09.563373 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae618a90-ee5f-4a36-90c8-bbd765a95dd9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:09.563859 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae618a90-ee5f-4a36-90c8-bbd765a95dd9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:09.564332 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae618a90-ee5f-4a36-90c8-bbd765a95dd9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:09.565061 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae618a90-ee5f-4a36-90c8-bbd765a95dd9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:09.565739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae618a90-ee5f-4a36-90c8-bbd765a95dd9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:09.566250 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae618a90-ee5f-4a36-90c8-bbd765a95dd9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:09.697156 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ae618a90-ee5f-4a36-90c8-bbd765a95dd9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:09.705779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ae618a90-ee5f-4a36-90c8-bbd765a95dd9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:09.707278 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ae618a90-ee5f-4a36-90c8-bbd765a95dd9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:09.708419 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ae618a90-ee5f-4a36-90c8-bbd765a95dd9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.157502 Aug 24 09:00:09.709040 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 243/500] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:09 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:10.731535 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c29072c4-333a-4ab6-917d-43ab89411fde tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:10.732413 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c29072c4-333a-4ab6-917d-43ab89411fde tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:10.740632 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c29072c4-333a-4ab6-917d-43ab89411fde tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:10.741127 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c29072c4-333a-4ab6-917d-43ab89411fde tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:10.741565 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c29072c4-333a-4ab6-917d-43ab89411fde tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:10.742267 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c29072c4-333a-4ab6-917d-43ab89411fde tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:10.742718 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c29072c4-333a-4ab6-917d-43ab89411fde tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:10.743141 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c29072c4-333a-4ab6-917d-43ab89411fde tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:10.877586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c29072c4-333a-4ab6-917d-43ab89411fde tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:10.885715 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c29072c4-333a-4ab6-917d-43ab89411fde tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:10.887915 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c29072c4-333a-4ab6-917d-43ab89411fde tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:10.889101 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c29072c4-333a-4ab6-917d-43ab89411fde tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.162306 Aug 24 09:00:10.889659 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 258/501] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:10 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:11.912366 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ba18dd6f-f0ee-4bf9-b2c9-b2199b9a04b0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:11.913013 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ba18dd6f-f0ee-4bf9-b2c9-b2199b9a04b0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:11.919981 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ba18dd6f-f0ee-4bf9-b2c9-b2199b9a04b0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:11.920454 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ba18dd6f-f0ee-4bf9-b2c9-b2199b9a04b0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:11.920909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ba18dd6f-f0ee-4bf9-b2c9-b2199b9a04b0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:11.921595 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ba18dd6f-f0ee-4bf9-b2c9-b2199b9a04b0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:11.922037 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ba18dd6f-f0ee-4bf9-b2c9-b2199b9a04b0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:11.922447 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ba18dd6f-f0ee-4bf9-b2c9-b2199b9a04b0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:12.070896 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ba18dd6f-f0ee-4bf9-b2c9-b2199b9a04b0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:12.079434 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ba18dd6f-f0ee-4bf9-b2c9-b2199b9a04b0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:12.080979 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ba18dd6f-f0ee-4bf9-b2c9-b2199b9a04b0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:12.082217 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ba18dd6f-f0ee-4bf9-b2c9-b2199b9a04b0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.173809 Aug 24 09:00:12.082777 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 244/502] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:11 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:13.105346 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-39527e47-e9ee-4a91-aa1d-ecafca2f3839 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:13.106055 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-39527e47-e9ee-4a91-aa1d-ecafca2f3839 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:13.112562 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-39527e47-e9ee-4a91-aa1d-ecafca2f3839 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:13.113132 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-39527e47-e9ee-4a91-aa1d-ecafca2f3839 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:13.113563 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-39527e47-e9ee-4a91-aa1d-ecafca2f3839 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:13.114258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-39527e47-e9ee-4a91-aa1d-ecafca2f3839 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:13.114710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-39527e47-e9ee-4a91-aa1d-ecafca2f3839 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:13.115132 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-39527e47-e9ee-4a91-aa1d-ecafca2f3839 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:13.256060 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-39527e47-e9ee-4a91-aa1d-ecafca2f3839 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:13.265369 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-39527e47-e9ee-4a91-aa1d-ecafca2f3839 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:13.266870 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-39527e47-e9ee-4a91-aa1d-ecafca2f3839 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:13.268020 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-39527e47-e9ee-4a91-aa1d-ecafca2f3839 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.166676 Aug 24 09:00:13.268593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 259/503] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:13 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:14.291571 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-15fdd1e9-0631-4783-846d-78e1a2be1c1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:14.292189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-15fdd1e9-0631-4783-846d-78e1a2be1c1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:14.299564 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15fdd1e9-0631-4783-846d-78e1a2be1c1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:14.300044 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15fdd1e9-0631-4783-846d-78e1a2be1c1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:14.300482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15fdd1e9-0631-4783-846d-78e1a2be1c1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:14.301241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15fdd1e9-0631-4783-846d-78e1a2be1c1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:14.301678 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15fdd1e9-0631-4783-846d-78e1a2be1c1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:14.302096 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-15fdd1e9-0631-4783-846d-78e1a2be1c1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:14.440889 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-15fdd1e9-0631-4783-846d-78e1a2be1c1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:14.456864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-15fdd1e9-0631-4783-846d-78e1a2be1c1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:14.458268 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-15fdd1e9-0631-4783-846d-78e1a2be1c1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:14.459483 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-15fdd1e9-0631-4783-846d-78e1a2be1c1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.171941 Aug 24 09:00:14.460039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 245/504] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:14 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:15.484381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ac2dff1d-c782-4bd7-a0a0-9e0be92301ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:15.484996 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ac2dff1d-c782-4bd7-a0a0-9e0be92301ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:15.491743 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ac2dff1d-c782-4bd7-a0a0-9e0be92301ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:15.492237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ac2dff1d-c782-4bd7-a0a0-9e0be92301ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:15.492711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ac2dff1d-c782-4bd7-a0a0-9e0be92301ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:15.493476 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ac2dff1d-c782-4bd7-a0a0-9e0be92301ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:15.493936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ac2dff1d-c782-4bd7-a0a0-9e0be92301ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:15.494359 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ac2dff1d-c782-4bd7-a0a0-9e0be92301ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:15.632287 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ac2dff1d-c782-4bd7-a0a0-9e0be92301ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:15.641461 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ac2dff1d-c782-4bd7-a0a0-9e0be92301ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:15.643121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ac2dff1d-c782-4bd7-a0a0-9e0be92301ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:15.644272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ac2dff1d-c782-4bd7-a0a0-9e0be92301ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.164453 Aug 24 09:00:15.644896 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 260/505] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:15 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:15.952556 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2126678329", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-320820006", "security_groups": [{"name": "tempest-secgroup-smoke-324555672"}], "block_device_mapping_v2": [{"uuid": "2786696b-0612-4a01-9541-85835db571f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a248e98a-364e-44f4-bc7f-3b491742a7df"}]}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:16.067193 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.network.neutron [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] validate_networks() for [('a248e98a-364e-44f4-bc7f-3b491742a7df', None, None, None, None, None)] {{(pid=132985) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:00:16.482293 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Flavor limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:00:16.482732 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Image limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:00:16.483233 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Flavor pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:00:16.483644 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Image pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:00:16.484033 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:00:16.493420 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:16.493892 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:16.494339 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:16.495032 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:16.496016 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:16.496515 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:16.514836 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Getting quotas for project 1f01e21018a54220ba1e54c6b7bfc400. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:00:16.519798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Getting quotas for user c2c3752027f342a489e6eb9d3b540819 and project 1f01e21018a54220ba1e54c6b7bfc400. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:00:16.595345 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Going to run 1 instances... {{(pid=132985) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:00:16.597648 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2786696b-0612-4a01-9541-85835db571f2',volume_size=None,volume_type=None)] {{(pid=132985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:00:16.669233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a0635143-381a-46e5-b47d-13a67c04b19b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:16.669832 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a0635143-381a-46e5-b47d-13a67c04b19b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:16.676382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0635143-381a-46e5-b47d-13a67c04b19b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:16.677064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0635143-381a-46e5-b47d-13a67c04b19b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:16.677758 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0635143-381a-46e5-b47d-13a67c04b19b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:16.678618 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0635143-381a-46e5-b47d-13a67c04b19b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:16.679071 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0635143-381a-46e5-b47d-13a67c04b19b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:16.679526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0635143-381a-46e5-b47d-13a67c04b19b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:16.695619 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:16.829873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a0635143-381a-46e5-b47d-13a67c04b19b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:16.839650 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a0635143-381a-46e5-b47d-13a67c04b19b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:16.841256 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a0635143-381a-46e5-b47d-13a67c04b19b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:16.842500 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a0635143-381a-46e5-b47d-13a67c04b19b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.177886 Aug 24 09:00:16.843063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 261/506] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:16 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:17.062272 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d65a8510-34f2-41ae-8d2b-1bdb9e31e045 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.113326 Aug 24 09:00:17.066299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 246/507] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 09:00:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:00:17.074221 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ff7f4c6a-76a7-4b74-8132-ba1b4606762e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:17.074825 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ff7f4c6a-76a7-4b74-8132-ba1b4606762e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:17.130925 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ff7f4c6a-76a7-4b74-8132-ba1b4606762e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:17.141751 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ff7f4c6a-76a7-4b74-8132-ba1b4606762e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1094 microversion: 2.1 time: 0.071755 Aug 24 09:00:17.142343 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 262/508] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:17 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:17.867161 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7b13911f-6aae-470f-a926-344f7edbef52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:17.867943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-7b13911f-6aae-470f-a926-344f7edbef52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:17.871676 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:17.875335 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7b13911f-6aae-470f-a926-344f7edbef52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:17.875820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7b13911f-6aae-470f-a926-344f7edbef52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:17.876256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7b13911f-6aae-470f-a926-344f7edbef52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:17.876994 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7b13911f-6aae-470f-a926-344f7edbef52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:17.877445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7b13911f-6aae-470f-a926-344f7edbef52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:17.877868 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7b13911f-6aae-470f-a926-344f7edbef52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:17.881930 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:18.057013 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f9e7dfb7-04ad-4089-ac5f-f1ed43390609 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Action: 'create', calling method: .version_select at 0x7f16ae4b3160>, body: {"keypair": {"name": "tempest-keypair-643443182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZoYZ3TdZ2kZ4AHY4n2e6nrb7qc/7Vbvk9H9wo84Rm24yBMLA1ieq3svRuGexV1ubM7hibBj5d88vpkbwA/pT4qxXq3gKg+2WbOUNQSphVXo0bhi87x/8lMSLdiiaAaOw=="}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:18.076506 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-f9e7dfb7-04ad-4089-ac5f-f1ed43390609 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for project 3809ac47fe214dda92729d4c89648a17. Resources: {'key_pairs'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:00:18.081292 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-f9e7dfb7-04ad-4089-ac5f-f1ed43390609 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for user 993697d33b7841668b1eabcdcd6b40f9 and project 3809ac47fe214dda92729d4c89648a17. Resources: {'key_pairs'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:00:18.265131 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f9e7dfb7-04ad-4089-ac5f-f1ed43390609 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.200958 Aug 24 09:00:18.265131 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 263/509] 10.222.0.55 () {60 vars in 1159 bytes} [Wed Aug 24 09:00:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:00:18.265131 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-26a6b258-c620-4a64-96f2-1fd7d1a0dc4b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:18.265131 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-26a6b258-c620-4a64-96f2-1fd7d1a0dc4b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:18.271098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-26a6b258-c620-4a64-96f2-1fd7d1a0dc4b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:18.271855 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-26a6b258-c620-4a64-96f2-1fd7d1a0dc4b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:18.272993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-26a6b258-c620-4a64-96f2-1fd7d1a0dc4b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:18.274648 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-26a6b258-c620-4a64-96f2-1fd7d1a0dc4b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:18.275443 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-26a6b258-c620-4a64-96f2-1fd7d1a0dc4b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:18.276019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-26a6b258-c620-4a64-96f2-1fd7d1a0dc4b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:18.284399 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7b13911f-6aae-470f-a926-344f7edbef52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:18.306001 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7b13911f-6aae-470f-a926-344f7edbef52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:18.308606 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7b13911f-6aae-470f-a926-344f7edbef52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:18.311930 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7b13911f-6aae-470f-a926-344f7edbef52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.448768 Aug 24 09:00:18.312617 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 247/510] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:17 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:18.317566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f0941a3b-9756-4ecb-b8fa-f7f54e867f09 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:18.318370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f0941a3b-9756-4ecb-b8fa-f7f54e867f09 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:18.326572 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f0941a3b-9756-4ecb-b8fa-f7f54e867f09 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:18.327266 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f0941a3b-9756-4ecb-b8fa-f7f54e867f09 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:18.327762 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f0941a3b-9756-4ecb-b8fa-f7f54e867f09 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:18.328656 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f0941a3b-9756-4ecb-b8fa-f7f54e867f09 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:18.329171 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f0941a3b-9756-4ecb-b8fa-f7f54e867f09 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:18.333091 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f0941a3b-9756-4ecb-b8fa-f7f54e867f09 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:18.374641 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-26a6b258-c620-4a64-96f2-1fd7d1a0dc4b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:18.387291 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-26a6b258-c620-4a64-96f2-1fd7d1a0dc4b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1144 microversion: 2.1 time: 0.127811 Aug 24 09:00:18.387291 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 264/511] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:18 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1144 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:18.432371 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-f0941a3b-9756-4ecb-b8fa-f7f54e867f09 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lazy-loading 'services' on Instance uuid e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:00:18.668965 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f0941a3b-9756-4ecb-b8fa-f7f54e867f09 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5/os-volume_attachments/bb9d87b3-a01e-488c-8b6c-7558a8196d1f" status: 202 len: 0 microversion: 2.1 time: 0.354971 Aug 24 09:00:18.669596 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 248/512] 10.222.0.55 () {58 vars in 1416 bytes} [Wed Aug 24 09:00:18 2022] DELETE /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5/os-volume_attachments/bb9d87b3-a01e-488c-8b6c-7558a8196d1f => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:00:19.337980 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-24a2e6d9-664d-4564-9930-e9a06ff9ed79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:19.338635 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-24a2e6d9-664d-4564-9930-e9a06ff9ed79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:19.346128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-24a2e6d9-664d-4564-9930-e9a06ff9ed79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:19.346613 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-24a2e6d9-664d-4564-9930-e9a06ff9ed79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:19.347049 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-24a2e6d9-664d-4564-9930-e9a06ff9ed79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:19.347741 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-24a2e6d9-664d-4564-9930-e9a06ff9ed79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:19.348249 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-24a2e6d9-664d-4564-9930-e9a06ff9ed79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:19.348731 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-24a2e6d9-664d-4564-9930-e9a06ff9ed79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:19.420094 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-bc857ea3-087d-4704-ac76-77c826c0ea5c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:19.420094 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-bc857ea3-087d-4704-ac76-77c826c0ea5c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:19.427556 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bc857ea3-087d-4704-ac76-77c826c0ea5c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:19.428043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bc857ea3-087d-4704-ac76-77c826c0ea5c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:19.428464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bc857ea3-087d-4704-ac76-77c826c0ea5c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:19.429441 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bc857ea3-087d-4704-ac76-77c826c0ea5c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:19.430062 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bc857ea3-087d-4704-ac76-77c826c0ea5c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:19.430541 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bc857ea3-087d-4704-ac76-77c826c0ea5c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:19.514401 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-24a2e6d9-664d-4564-9930-e9a06ff9ed79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:19.524366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-24a2e6d9-664d-4564-9930-e9a06ff9ed79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:19.527156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-24a2e6d9-664d-4564-9930-e9a06ff9ed79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:19.528510 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-24a2e6d9-664d-4564-9930-e9a06ff9ed79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.194427 Aug 24 09:00:19.529378 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 265/513] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:19 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:19.532797 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-bc857ea3-087d-4704-ac76-77c826c0ea5c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:19.546482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-bc857ea3-087d-4704-ac76-77c826c0ea5c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1192 microversion: 2.1 time: 0.131571 Aug 24 09:00:19.547874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 249/514] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:19 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1192 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:20.556999 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-32a4a991-3872-4c5d-ad32-48610b5eff8c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:20.557850 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-32a4a991-3872-4c5d-ad32-48610b5eff8c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:20.565035 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-32a4a991-3872-4c5d-ad32-48610b5eff8c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:20.565538 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-32a4a991-3872-4c5d-ad32-48610b5eff8c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:20.566133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-32a4a991-3872-4c5d-ad32-48610b5eff8c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:20.566711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-32a4a991-3872-4c5d-ad32-48610b5eff8c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:20.567407 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-32a4a991-3872-4c5d-ad32-48610b5eff8c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:20.567976 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-32a4a991-3872-4c5d-ad32-48610b5eff8c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:20.574241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9054c76c-6bad-42dc-8aa4-634c74e2420c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:20.584603 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9054c76c-6bad-42dc-8aa4-634c74e2420c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:20.588049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9054c76c-6bad-42dc-8aa4-634c74e2420c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:20.588564 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9054c76c-6bad-42dc-8aa4-634c74e2420c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:20.589514 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9054c76c-6bad-42dc-8aa4-634c74e2420c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:20.590223 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9054c76c-6bad-42dc-8aa4-634c74e2420c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:20.592069 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9054c76c-6bad-42dc-8aa4-634c74e2420c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:20.592815 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9054c76c-6bad-42dc-8aa4-634c74e2420c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:20.664794 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9054c76c-6bad-42dc-8aa4-634c74e2420c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:20.673405 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9054c76c-6bad-42dc-8aa4-634c74e2420c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1210 microversion: 2.1 time: 0.106421 Aug 24 09:00:20.674177 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 250/515] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:20 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:20.856127 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-32a4a991-3872-4c5d-ad32-48610b5eff8c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:20.864933 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-32a4a991-3872-4c5d-ad32-48610b5eff8c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:20.866675 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-32a4a991-3872-4c5d-ad32-48610b5eff8c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:20.871467 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-32a4a991-3872-4c5d-ad32-48610b5eff8c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.315230 Aug 24 09:00:20.871467 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 266/516] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:20 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:21.696095 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4f08b841-6fbe-4f7b-a830-86388af40f69 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:21.696928 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4f08b841-6fbe-4f7b-a830-86388af40f69 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:21.704608 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f08b841-6fbe-4f7b-a830-86388af40f69 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:21.714136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f08b841-6fbe-4f7b-a830-86388af40f69 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:21.714136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f08b841-6fbe-4f7b-a830-86388af40f69 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:21.714136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f08b841-6fbe-4f7b-a830-86388af40f69 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:21.714136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f08b841-6fbe-4f7b-a830-86388af40f69 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:21.714608 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f08b841-6fbe-4f7b-a830-86388af40f69 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:21.818055 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1223120020", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce3c3cdc-b3eb-437a-9009-2b2f1c4b657c"}], "security_groups": [{"name": "tempest-securitygroup--541058438"}], "key_name": "tempest-keypair-643443182", "user_data": "}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:21.827849 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:21.864752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4f08b841-6fbe-4f7b-a830-86388af40f69 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:21.873722 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4f08b841-6fbe-4f7b-a830-86388af40f69 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.181857 Aug 24 09:00:21.874295 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 251/517] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:21 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:21.897991 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3fdb617f-49d3-4fdb-82f3-c72f785fe30c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:21.899076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3fdb617f-49d3-4fdb-82f3-c72f785fe30c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:21.910336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3fdb617f-49d3-4fdb-82f3-c72f785fe30c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:21.911220 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3fdb617f-49d3-4fdb-82f3-c72f785fe30c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:21.911984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3fdb617f-49d3-4fdb-82f3-c72f785fe30c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:21.913157 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3fdb617f-49d3-4fdb-82f3-c72f785fe30c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:21.918880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3fdb617f-49d3-4fdb-82f3-c72f785fe30c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:21.918880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3fdb617f-49d3-4fdb-82f3-c72f785fe30c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:22.018356 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.network.neutron [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] validate_networks() for [('ce3c3cdc-b3eb-437a-9009-2b2f1c4b657c', None, None, None, None, None)] {{(pid=132984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:00:22.096916 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3fdb617f-49d3-4fdb-82f3-c72f785fe30c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:22.106059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3fdb617f-49d3-4fdb-82f3-c72f785fe30c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:22.108782 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3fdb617f-49d3-4fdb-82f3-c72f785fe30c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:22.110282 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3fdb617f-49d3-4fdb-82f3-c72f785fe30c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.219838 Aug 24 09:00:22.111363 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 252/518] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:21 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:22.171142 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-ae3eb345-670c-481e-9be7-2679419f9610 req-beba26e3-2e5c-4be7-8b91-d793c28e8841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abdb5828-315b-4046-9985-95e58a2f24b3", "name": "network-vif-plugged", "status": "completed", "tag": "756cdfb7-826d-4039-9977-c15d62078dd5"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:22.186641 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-ae3eb345-670c-481e-9be7-2679419f9610 req-beba26e3-2e5c-4be7-8b91-d793c28e8841 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:22.188318 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-ae3eb345-670c-481e-9be7-2679419f9610 req-beba26e3-2e5c-4be7-8b91-d793c28e8841 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:22.188816 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-ae3eb345-670c-481e-9be7-2679419f9610 req-beba26e3-2e5c-4be7-8b91-d793c28e8841 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:22.212726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-ae3eb345-670c-481e-9be7-2679419f9610 req-beba26e3-2e5c-4be7-8b91-d793c28e8841 service nova] Creating event network-vif-plugged:756cdfb7-826d-4039-9977-c15d62078dd5 for instance abdb5828-315b-4046-9985-95e58a2f24b3 on hv-cinder-85221 Aug 24 09:00:22.219144 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-ae3eb345-670c-481e-9be7-2679419f9610 req-beba26e3-2e5c-4be7-8b91-d793c28e8841 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052648 Aug 24 09:00:22.221037 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 253/519] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:00:22.692179 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Flavor limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:00:22.692179 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Image limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:00:22.692179 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Flavor pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:00:22.692780 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Image pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:00:22.693204 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:00:22.702243 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:22.702747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:22.703175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:22.703992 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:22.704318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:22.704761 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:22.724812 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for project 3809ac47fe214dda92729d4c89648a17. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:00:22.726144 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for user 993697d33b7841668b1eabcdcd6b40f9 and project 3809ac47fe214dda92729d4c89648a17. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:00:22.737566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Going to run 1 instances... {{(pid=132984) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:00:22.739833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:00:22.885655 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9da8c854-406a-4f2b-8412-c587aa6a8b2f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.072191 Aug 24 09:00:22.886991 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 267/520] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 09:00:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 09:00:22.898804 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-19d10557-0b80-46f3-a91b-d8497b33b694 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:22.899525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-19d10557-0b80-46f3-a91b-d8497b33b694 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:22.902787 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cef6a780-4d3e-4994-aaf9-6efea42f7618 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:22.908027 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-cef6a780-4d3e-4994-aaf9-6efea42f7618 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:22.913873 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cef6a780-4d3e-4994-aaf9-6efea42f7618 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:22.914536 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cef6a780-4d3e-4994-aaf9-6efea42f7618 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:22.915052 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cef6a780-4d3e-4994-aaf9-6efea42f7618 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:22.916264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cef6a780-4d3e-4994-aaf9-6efea42f7618 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:22.916981 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cef6a780-4d3e-4994-aaf9-6efea42f7618 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:22.918087 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cef6a780-4d3e-4994-aaf9-6efea42f7618 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:22.989924 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-19d10557-0b80-46f3-a91b-d8497b33b694 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:22.998258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-19d10557-0b80-46f3-a91b-d8497b33b694 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1241 microversion: 2.1 time: 0.103990 Aug 24 09:00:22.999336 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 268/521] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:22 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:23.133538 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-cef6a780-4d3e-4994-aaf9-6efea42f7618 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:23.142096 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c307be05-e7ce-47c8-8491-c1d57c0aa84d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:23.142940 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-cef6a780-4d3e-4994-aaf9-6efea42f7618 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.250074 Aug 24 09:00:23.143065 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c307be05-e7ce-47c8-8491-c1d57c0aa84d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:23.144570 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 254/522] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:22 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:23.163017 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-fe92bad8-4aa4-429f-bff3-fd9f03f7f3a7 req-417bae51-988d-4ddf-bcad-e601a696683e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20347088-35b8-4cfe-8457-8ca131fcfa2c", "tag": "df5ed933-769b-4275-a845-9beb266eb36d"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:23.165772 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c307be05-e7ce-47c8-8491-c1d57c0aa84d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:23.166614 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c307be05-e7ce-47c8-8491-c1d57c0aa84d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:23.167930 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c307be05-e7ce-47c8-8491-c1d57c0aa84d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:23.168888 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c307be05-e7ce-47c8-8491-c1d57c0aa84d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:23.169535 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c307be05-e7ce-47c8-8491-c1d57c0aa84d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:23.170143 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c307be05-e7ce-47c8-8491-c1d57c0aa84d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:23.180212 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-fe92bad8-4aa4-429f-bff3-fd9f03f7f3a7 req-417bae51-988d-4ddf-bcad-e601a696683e service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:23.181074 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-fe92bad8-4aa4-429f-bff3-fd9f03f7f3a7 req-417bae51-988d-4ddf-bcad-e601a696683e service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:23.181914 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-fe92bad8-4aa4-429f-bff3-fd9f03f7f3a7 req-417bae51-988d-4ddf-bcad-e601a696683e service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:23.202221 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-fe92bad8-4aa4-429f-bff3-fd9f03f7f3a7 req-417bae51-988d-4ddf-bcad-e601a696683e service nova] Creating event network-changed:df5ed933-769b-4275-a845-9beb266eb36d for instance 20347088-35b8-4cfe-8457-8ca131fcfa2c on hv-cinder-85221 Aug 24 09:00:23.208194 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-fe92bad8-4aa4-429f-bff3-fd9f03f7f3a7 req-417bae51-988d-4ddf-bcad-e601a696683e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051099 Aug 24 09:00:23.208893 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 255/523] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:23.330075 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c307be05-e7ce-47c8-8491-c1d57c0aa84d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:23.339512 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c307be05-e7ce-47c8-8491-c1d57c0aa84d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:23.341068 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c307be05-e7ce-47c8-8491-c1d57c0aa84d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:23.342249 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c307be05-e7ce-47c8-8491-c1d57c0aa84d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.204561 Aug 24 09:00:23.342811 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 269/524] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:23 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:24.019824 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cc69de8b-09a2-468d-aa23-fd9417f8cee2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:24.020529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-cc69de8b-09a2-468d-aa23-fd9417f8cee2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:24.028296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cc69de8b-09a2-468d-aa23-fd9417f8cee2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:24.028814 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cc69de8b-09a2-468d-aa23-fd9417f8cee2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:24.029235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cc69de8b-09a2-468d-aa23-fd9417f8cee2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:24.030233 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cc69de8b-09a2-468d-aa23-fd9417f8cee2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:24.030726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cc69de8b-09a2-468d-aa23-fd9417f8cee2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:24.031142 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cc69de8b-09a2-468d-aa23-fd9417f8cee2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:24.099930 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-cc69de8b-09a2-468d-aa23-fd9417f8cee2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:24.107947 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-cc69de8b-09a2-468d-aa23-fd9417f8cee2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1245 microversion: 2.1 time: 0.092246 Aug 24 09:00:24.108523 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 256/525] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:24 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:24.164836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1004f242-ecef-4b93-be5f-97fdc5d9ef23 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:24.165467 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1004f242-ecef-4b93-be5f-97fdc5d9ef23 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:24.171783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1004f242-ecef-4b93-be5f-97fdc5d9ef23 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:24.172264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1004f242-ecef-4b93-be5f-97fdc5d9ef23 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:24.172736 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1004f242-ecef-4b93-be5f-97fdc5d9ef23 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:24.173432 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1004f242-ecef-4b93-be5f-97fdc5d9ef23 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:24.173877 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1004f242-ecef-4b93-be5f-97fdc5d9ef23 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:24.174292 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1004f242-ecef-4b93-be5f-97fdc5d9ef23 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:24.335693 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1004f242-ecef-4b93-be5f-97fdc5d9ef23 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:24.344227 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1004f242-ecef-4b93-be5f-97fdc5d9ef23 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.183038 Aug 24 09:00:24.344871 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 270/526] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:24 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:24.365587 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-75e13799-898d-4001-8b44-5d11801a6465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:24.366211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-75e13799-898d-4001-8b44-5d11801a6465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:24.373726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-75e13799-898d-4001-8b44-5d11801a6465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:24.374207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-75e13799-898d-4001-8b44-5d11801a6465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:24.374632 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-75e13799-898d-4001-8b44-5d11801a6465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:24.375338 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-75e13799-898d-4001-8b44-5d11801a6465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:24.375787 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-75e13799-898d-4001-8b44-5d11801a6465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:24.376203 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-75e13799-898d-4001-8b44-5d11801a6465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:24.516581 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-75e13799-898d-4001-8b44-5d11801a6465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:24.525486 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-75e13799-898d-4001-8b44-5d11801a6465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:24.527068 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-75e13799-898d-4001-8b44-5d11801a6465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:24.528279 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-75e13799-898d-4001-8b44-5d11801a6465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.166721 Aug 24 09:00:24.528890 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 257/527] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:24 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:25.129483 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ba9f83c3-8600-41a2-b6f8-dd3e4b6bcc45 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:25.130186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ba9f83c3-8600-41a2-b6f8-dd3e4b6bcc45 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:25.136472 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ba9f83c3-8600-41a2-b6f8-dd3e4b6bcc45 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:25.136985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ba9f83c3-8600-41a2-b6f8-dd3e4b6bcc45 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:25.137410 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ba9f83c3-8600-41a2-b6f8-dd3e4b6bcc45 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:25.138395 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ba9f83c3-8600-41a2-b6f8-dd3e4b6bcc45 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:25.138850 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ba9f83c3-8600-41a2-b6f8-dd3e4b6bcc45 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:25.139274 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ba9f83c3-8600-41a2-b6f8-dd3e4b6bcc45 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:25.209324 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ba9f83c3-8600-41a2-b6f8-dd3e4b6bcc45 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:25.220817 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ba9f83c3-8600-41a2-b6f8-dd3e4b6bcc45 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1245 microversion: 2.1 time: 0.095153 Aug 24 09:00:25.221401 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 271/528] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:25 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:25.365821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-79cce734-9ec0-4e72-a307-13ba4c15adf4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:25.366594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-79cce734-9ec0-4e72-a307-13ba4c15adf4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:25.374004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-79cce734-9ec0-4e72-a307-13ba4c15adf4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:25.374486 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-79cce734-9ec0-4e72-a307-13ba4c15adf4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:25.374910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-79cce734-9ec0-4e72-a307-13ba4c15adf4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:25.375629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-79cce734-9ec0-4e72-a307-13ba4c15adf4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:25.376074 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-79cce734-9ec0-4e72-a307-13ba4c15adf4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:25.376489 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-79cce734-9ec0-4e72-a307-13ba4c15adf4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:25.522904 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-79cce734-9ec0-4e72-a307-13ba4c15adf4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:25.531950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-79cce734-9ec0-4e72-a307-13ba4c15adf4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.170098 Aug 24 09:00:25.532560 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 258/529] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:25 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:25.551536 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e4f3d812-f408-474d-b146-8ad32af9645b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:25.552156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e4f3d812-f408-474d-b146-8ad32af9645b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:25.558916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e4f3d812-f408-474d-b146-8ad32af9645b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:25.559405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e4f3d812-f408-474d-b146-8ad32af9645b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:25.559840 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e4f3d812-f408-474d-b146-8ad32af9645b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:25.560559 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e4f3d812-f408-474d-b146-8ad32af9645b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:25.561180 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e4f3d812-f408-474d-b146-8ad32af9645b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:25.561624 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e4f3d812-f408-474d-b146-8ad32af9645b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:25.717496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e4f3d812-f408-474d-b146-8ad32af9645b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:25.726066 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e4f3d812-f408-474d-b146-8ad32af9645b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:25.727575 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e4f3d812-f408-474d-b146-8ad32af9645b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:25.728781 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e4f3d812-f408-474d-b146-8ad32af9645b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.181277 Aug 24 09:00:25.729359 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 272/530] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:25 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:26.242771 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-54970f14-104a-47b9-89ba-2eb90a889073 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:26.243212 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-54970f14-104a-47b9-89ba-2eb90a889073 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:26.250906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54970f14-104a-47b9-89ba-2eb90a889073 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:26.251527 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54970f14-104a-47b9-89ba-2eb90a889073 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:26.252126 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54970f14-104a-47b9-89ba-2eb90a889073 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:26.252980 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54970f14-104a-47b9-89ba-2eb90a889073 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:26.253714 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54970f14-104a-47b9-89ba-2eb90a889073 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:26.254420 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54970f14-104a-47b9-89ba-2eb90a889073 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:26.325688 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-54970f14-104a-47b9-89ba-2eb90a889073 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:26.333950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-54970f14-104a-47b9-89ba-2eb90a889073 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1245 microversion: 2.1 time: 0.095530 Aug 24 09:00:26.334528 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 259/531] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:26 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:26.554834 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8983891b-353f-4fd7-bd88-ecb7fa742d63 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:26.555861 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8983891b-353f-4fd7-bd88-ecb7fa742d63 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:26.566828 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8983891b-353f-4fd7-bd88-ecb7fa742d63 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:26.567314 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8983891b-353f-4fd7-bd88-ecb7fa742d63 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:26.567752 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8983891b-353f-4fd7-bd88-ecb7fa742d63 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:26.568463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8983891b-353f-4fd7-bd88-ecb7fa742d63 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:26.568970 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8983891b-353f-4fd7-bd88-ecb7fa742d63 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:26.569396 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8983891b-353f-4fd7-bd88-ecb7fa742d63 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:26.717270 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8983891b-353f-4fd7-bd88-ecb7fa742d63 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:26.726182 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8983891b-353f-4fd7-bd88-ecb7fa742d63 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.176408 Aug 24 09:00:26.726763 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 273/532] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:26 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:26.752509 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9723d5c1-fc41-4986-bd3b-781ae5d80705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:26.753190 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9723d5c1-fc41-4986-bd3b-781ae5d80705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:26.756045 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:26.756771 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=6 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:26.762845 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9723d5c1-fc41-4986-bd3b-781ae5d80705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:26.763637 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9723d5c1-fc41-4986-bd3b-781ae5d80705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:26.764070 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9723d5c1-fc41-4986-bd3b-781ae5d80705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:26.764820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9723d5c1-fc41-4986-bd3b-781ae5d80705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:26.772911 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9723d5c1-fc41-4986-bd3b-781ae5d80705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:26.772911 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9723d5c1-fc41-4986-bd3b-781ae5d80705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:26.903807 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9723d5c1-fc41-4986-bd3b-781ae5d80705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:26.912786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9723d5c1-fc41-4986-bd3b-781ae5d80705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:26.914289 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9723d5c1-fc41-4986-bd3b-781ae5d80705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:26.915460 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9723d5c1-fc41-4986-bd3b-781ae5d80705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.167142 Aug 24 09:00:26.916115 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 260/533] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:26 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:27.357848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-10e9126d-20a7-43a4-af18-b5195a8ff50c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:27.358470 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-10e9126d-20a7-43a4-af18-b5195a8ff50c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:27.365072 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-10e9126d-20a7-43a4-af18-b5195a8ff50c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:27.365640 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-10e9126d-20a7-43a4-af18-b5195a8ff50c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:27.366165 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-10e9126d-20a7-43a4-af18-b5195a8ff50c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:27.366880 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-10e9126d-20a7-43a4-af18-b5195a8ff50c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:27.367332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-10e9126d-20a7-43a4-af18-b5195a8ff50c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:27.367753 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-10e9126d-20a7-43a4-af18-b5195a8ff50c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:27.437727 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-10e9126d-20a7-43a4-af18-b5195a8ff50c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:27.445816 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-10e9126d-20a7-43a4-af18-b5195a8ff50c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1245 microversion: 2.1 time: 0.092842 Aug 24 09:00:27.446396 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 274/534] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:27 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:27.748322 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9a0a8dd9-345d-4ab4-baa3-a5acbacef9f7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:27.748883 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9a0a8dd9-345d-4ab4-baa3-a5acbacef9f7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:27.755204 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a0a8dd9-345d-4ab4-baa3-a5acbacef9f7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:27.756008 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a0a8dd9-345d-4ab4-baa3-a5acbacef9f7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:27.756215 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a0a8dd9-345d-4ab4-baa3-a5acbacef9f7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:27.756923 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a0a8dd9-345d-4ab4-baa3-a5acbacef9f7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:27.757370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a0a8dd9-345d-4ab4-baa3-a5acbacef9f7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:27.757793 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a0a8dd9-345d-4ab4-baa3-a5acbacef9f7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:27.926697 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9a0a8dd9-345d-4ab4-baa3-a5acbacef9f7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:27.937575 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9a0a8dd9-345d-4ab4-baa3-a5acbacef9f7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.193776 Aug 24 09:00:27.938154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 261/535] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:27 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:27.944230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-695bad0f-33d7-4e28-8855-12902d13f80b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:27.945410 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-695bad0f-33d7-4e28-8855-12902d13f80b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:27.957254 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-695bad0f-33d7-4e28-8855-12902d13f80b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:27.958143 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-695bad0f-33d7-4e28-8855-12902d13f80b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:27.966459 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-695bad0f-33d7-4e28-8855-12902d13f80b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:27.966459 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-695bad0f-33d7-4e28-8855-12902d13f80b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:27.966459 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-695bad0f-33d7-4e28-8855-12902d13f80b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:27.966459 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-695bad0f-33d7-4e28-8855-12902d13f80b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:28.271512 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-695bad0f-33d7-4e28-8855-12902d13f80b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:28.283139 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-695bad0f-33d7-4e28-8855-12902d13f80b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:28.284883 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-695bad0f-33d7-4e28-8855-12902d13f80b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:28.286107 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-695bad0f-33d7-4e28-8855-12902d13f80b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.349646 Aug 24 09:00:28.286681 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 275/536] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:27 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:28.466880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-761de6e1-f274-4681-b04c-dd7535ff3591 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:28.467497 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-761de6e1-f274-4681-b04c-dd7535ff3591 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:28.474801 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-761de6e1-f274-4681-b04c-dd7535ff3591 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:28.475373 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-761de6e1-f274-4681-b04c-dd7535ff3591 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:28.476044 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-761de6e1-f274-4681-b04c-dd7535ff3591 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:28.476851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-761de6e1-f274-4681-b04c-dd7535ff3591 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:28.477347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-761de6e1-f274-4681-b04c-dd7535ff3591 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:28.477810 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-761de6e1-f274-4681-b04c-dd7535ff3591 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:28.624094 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-761de6e1-f274-4681-b04c-dd7535ff3591 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:28.632374 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-761de6e1-f274-4681-b04c-dd7535ff3591 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1245 microversion: 2.1 time: 0.169559 Aug 24 09:00:28.632999 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 262/537] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:28 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1245 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:28.960839 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e6da82c3-8a75-4959-bd22-81b19303c7c2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:28.961440 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e6da82c3-8a75-4959-bd22-81b19303c7c2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:28.969423 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e6da82c3-8a75-4959-bd22-81b19303c7c2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:28.969963 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e6da82c3-8a75-4959-bd22-81b19303c7c2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:28.970546 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e6da82c3-8a75-4959-bd22-81b19303c7c2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:28.971670 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e6da82c3-8a75-4959-bd22-81b19303c7c2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:28.972466 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e6da82c3-8a75-4959-bd22-81b19303c7c2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:28.973049 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e6da82c3-8a75-4959-bd22-81b19303c7c2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:29.138776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e6da82c3-8a75-4959-bd22-81b19303c7c2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:29.146710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e6da82c3-8a75-4959-bd22-81b19303c7c2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.190876 Aug 24 09:00:29.151557 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 276/538] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:28 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:29.310597 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d00abf33-72eb-4638-ac7e-ef3b169119bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:29.311464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d00abf33-72eb-4638-ac7e-ef3b169119bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:29.318295 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d00abf33-72eb-4638-ac7e-ef3b169119bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:29.318779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d00abf33-72eb-4638-ac7e-ef3b169119bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:29.319214 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d00abf33-72eb-4638-ac7e-ef3b169119bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:29.319906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d00abf33-72eb-4638-ac7e-ef3b169119bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:29.320351 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d00abf33-72eb-4638-ac7e-ef3b169119bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:29.320806 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d00abf33-72eb-4638-ac7e-ef3b169119bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:29.474561 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d00abf33-72eb-4638-ac7e-ef3b169119bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:29.483554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d00abf33-72eb-4638-ac7e-ef3b169119bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:29.485087 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d00abf33-72eb-4638-ac7e-ef3b169119bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:29.486254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d00abf33-72eb-4638-ac7e-ef3b169119bf tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.179734 Aug 24 09:00:29.486820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 263/539] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:29 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:29.653494 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-57da5578-f0fb-45db-ac13-8869e2701b04 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:29.654139 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-57da5578-f0fb-45db-ac13-8869e2701b04 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:29.660611 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57da5578-f0fb-45db-ac13-8869e2701b04 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:29.661703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57da5578-f0fb-45db-ac13-8869e2701b04 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:29.661703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57da5578-f0fb-45db-ac13-8869e2701b04 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:29.662423 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57da5578-f0fb-45db-ac13-8869e2701b04 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:29.662853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57da5578-f0fb-45db-ac13-8869e2701b04 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:29.663291 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57da5578-f0fb-45db-ac13-8869e2701b04 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:29.750654 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-57da5578-f0fb-45db-ac13-8869e2701b04 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:29.758814 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-57da5578-f0fb-45db-ac13-8869e2701b04 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1245 microversion: 2.1 time: 0.109123 Aug 24 09:00:29.759395 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 277/540] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:29 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:30.171285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-aca1ac8e-4ce5-4536-aac3-b9c311286bd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:30.171906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-aca1ac8e-4ce5-4536-aac3-b9c311286bd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:30.178309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aca1ac8e-4ce5-4536-aac3-b9c311286bd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:30.178864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aca1ac8e-4ce5-4536-aac3-b9c311286bd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:30.179411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aca1ac8e-4ce5-4536-aac3-b9c311286bd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:30.180133 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aca1ac8e-4ce5-4536-aac3-b9c311286bd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:30.180605 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aca1ac8e-4ce5-4536-aac3-b9c311286bd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:30.181059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aca1ac8e-4ce5-4536-aac3-b9c311286bd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:30.198352 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:30.331407 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-aca1ac8e-4ce5-4536-aac3-b9c311286bd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:30.346734 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-aca1ac8e-4ce5-4536-aac3-b9c311286bd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.179926 Aug 24 09:00:30.347516 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 264/541] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:30 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:30.510042 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6888a264-9b95-446d-8915-fa8c279a7c18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:30.510793 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6888a264-9b95-446d-8915-fa8c279a7c18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:30.517908 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6888a264-9b95-446d-8915-fa8c279a7c18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:30.518346 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6888a264-9b95-446d-8915-fa8c279a7c18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:30.518782 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6888a264-9b95-446d-8915-fa8c279a7c18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:30.519519 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6888a264-9b95-446d-8915-fa8c279a7c18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:30.519995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6888a264-9b95-446d-8915-fa8c279a7c18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:30.520419 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6888a264-9b95-446d-8915-fa8c279a7c18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:30.673338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6888a264-9b95-446d-8915-fa8c279a7c18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:30.691238 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6888a264-9b95-446d-8915-fa8c279a7c18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:30.693128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6888a264-9b95-446d-8915-fa8c279a7c18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:30.695131 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6888a264-9b95-446d-8915-fa8c279a7c18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.189327 Aug 24 09:00:30.695774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 278/542] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:30 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:30.780307 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3cc436f4-414f-4e78-8fbf-3d17223c51b7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:30.781069 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3cc436f4-414f-4e78-8fbf-3d17223c51b7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:30.787728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3cc436f4-414f-4e78-8fbf-3d17223c51b7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:30.790396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3cc436f4-414f-4e78-8fbf-3d17223c51b7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:30.790396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3cc436f4-414f-4e78-8fbf-3d17223c51b7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:30.790396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3cc436f4-414f-4e78-8fbf-3d17223c51b7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:30.790396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3cc436f4-414f-4e78-8fbf-3d17223c51b7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:30.790787 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3cc436f4-414f-4e78-8fbf-3d17223c51b7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:30.858260 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3cc436f4-414f-4e78-8fbf-3d17223c51b7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:30.874059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3cc436f4-414f-4e78-8fbf-3d17223c51b7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1245 microversion: 2.1 time: 0.097713 Aug 24 09:00:30.875119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 265/543] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:30 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:31.369499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e682b4fc-9a1f-47d5-91dd-f8e491d773b7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:31.370121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e682b4fc-9a1f-47d5-91dd-f8e491d773b7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:31.376801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e682b4fc-9a1f-47d5-91dd-f8e491d773b7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:31.377300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e682b4fc-9a1f-47d5-91dd-f8e491d773b7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:31.377734 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e682b4fc-9a1f-47d5-91dd-f8e491d773b7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:31.378513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e682b4fc-9a1f-47d5-91dd-f8e491d773b7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:31.378977 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e682b4fc-9a1f-47d5-91dd-f8e491d773b7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:31.379404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e682b4fc-9a1f-47d5-91dd-f8e491d773b7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:31.538889 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e682b4fc-9a1f-47d5-91dd-f8e491d773b7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:31.549031 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e682b4fc-9a1f-47d5-91dd-f8e491d773b7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.183527 Aug 24 09:00:31.549628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 279/544] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:31 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:31.728880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-67aa364c-732c-4c3f-b706-b1428d6efba0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:31.731463 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-67aa364c-732c-4c3f-b706-b1428d6efba0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:31.743951 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67aa364c-732c-4c3f-b706-b1428d6efba0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:31.744801 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67aa364c-732c-4c3f-b706-b1428d6efba0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:31.746796 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67aa364c-732c-4c3f-b706-b1428d6efba0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:31.748122 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67aa364c-732c-4c3f-b706-b1428d6efba0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:31.748888 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67aa364c-732c-4c3f-b706-b1428d6efba0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:31.749451 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67aa364c-732c-4c3f-b706-b1428d6efba0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:31.916251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c00dccdd-cb07-457b-a79a-59aa878572eb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:31.916251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c00dccdd-cb07-457b-a79a-59aa878572eb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:31.919056 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c00dccdd-cb07-457b-a79a-59aa878572eb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:31.919549 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c00dccdd-cb07-457b-a79a-59aa878572eb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:31.919988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c00dccdd-cb07-457b-a79a-59aa878572eb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:31.920746 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c00dccdd-cb07-457b-a79a-59aa878572eb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:31.921234 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c00dccdd-cb07-457b-a79a-59aa878572eb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:31.921660 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c00dccdd-cb07-457b-a79a-59aa878572eb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:31.948076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-67aa364c-732c-4c3f-b706-b1428d6efba0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:31.948076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-67aa364c-732c-4c3f-b706-b1428d6efba0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:31.948619 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-67aa364c-732c-4c3f-b706-b1428d6efba0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:31.948619 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-67aa364c-732c-4c3f-b706-b1428d6efba0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.219116 Aug 24 09:00:31.948619 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 266/545] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:31 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:32.004757 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c00dccdd-cb07-457b-a79a-59aa878572eb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:32.015231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c00dccdd-cb07-457b-a79a-59aa878572eb tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1245 microversion: 2.1 time: 0.108195 Aug 24 09:00:32.018606 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 280/546] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:31 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:32.569935 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b0251c3b-a457-42c7-b31c-4ba1ea794249 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:32.575378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b0251c3b-a457-42c7-b31c-4ba1ea794249 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:32.578096 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0251c3b-a457-42c7-b31c-4ba1ea794249 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:32.578636 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0251c3b-a457-42c7-b31c-4ba1ea794249 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:32.579157 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0251c3b-a457-42c7-b31c-4ba1ea794249 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:32.579874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0251c3b-a457-42c7-b31c-4ba1ea794249 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:32.580334 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0251c3b-a457-42c7-b31c-4ba1ea794249 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:32.580865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0251c3b-a457-42c7-b31c-4ba1ea794249 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:32.732331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b0251c3b-a457-42c7-b31c-4ba1ea794249 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:32.741401 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b0251c3b-a457-42c7-b31c-4ba1ea794249 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.175619 Aug 24 09:00:32.741993 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 267/547] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:32 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:32.960237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-951ff658-7ece-45ce-a770-978e929bc6fd tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:32.961108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-951ff658-7ece-45ce-a770-978e929bc6fd tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:32.963695 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:32.969294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-951ff658-7ece-45ce-a770-978e929bc6fd tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:32.969784 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-951ff658-7ece-45ce-a770-978e929bc6fd tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:32.970221 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-951ff658-7ece-45ce-a770-978e929bc6fd tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:32.970936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-951ff658-7ece-45ce-a770-978e929bc6fd tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:32.971390 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-951ff658-7ece-45ce-a770-978e929bc6fd tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:32.971862 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-951ff658-7ece-45ce-a770-978e929bc6fd tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:32.994342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=14 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:33.040666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fa1748f0-8244-4539-aba2-8db453ea6cfa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:33.041770 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-fa1748f0-8244-4539-aba2-8db453ea6cfa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:33.050197 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa1748f0-8244-4539-aba2-8db453ea6cfa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:33.050858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa1748f0-8244-4539-aba2-8db453ea6cfa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:33.051412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa1748f0-8244-4539-aba2-8db453ea6cfa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:33.052334 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa1748f0-8244-4539-aba2-8db453ea6cfa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:33.053073 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa1748f0-8244-4539-aba2-8db453ea6cfa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:33.053619 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa1748f0-8244-4539-aba2-8db453ea6cfa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:33.150344 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fa1748f0-8244-4539-aba2-8db453ea6cfa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:33.162964 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-951ff658-7ece-45ce-a770-978e929bc6fd tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:33.167101 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:33.170311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fa1748f0-8244-4539-aba2-8db453ea6cfa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1245 microversion: 2.1 time: 0.134501 Aug 24 09:00:33.171372 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 268/548] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:33 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1245 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:33.179782 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-951ff658-7ece-45ce-a770-978e929bc6fd tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:33.182431 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-951ff658-7ece-45ce-a770-978e929bc6fd tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:33.184081 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-951ff658-7ece-45ce-a770-978e929bc6fd tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.228021 Aug 24 09:00:33.185540 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 281/549] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:32 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:33.764126 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f64202b9-4d50-4169-ba01-075857003dd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:33.764902 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f64202b9-4d50-4169-ba01-075857003dd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:33.772121 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f64202b9-4d50-4169-ba01-075857003dd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:33.772634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f64202b9-4d50-4169-ba01-075857003dd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:33.773066 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f64202b9-4d50-4169-ba01-075857003dd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:33.773774 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f64202b9-4d50-4169-ba01-075857003dd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:33.774227 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f64202b9-4d50-4169-ba01-075857003dd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:33.774640 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f64202b9-4d50-4169-ba01-075857003dd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:33.943942 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f64202b9-4d50-4169-ba01-075857003dd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:33.955954 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f64202b9-4d50-4169-ba01-075857003dd4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.196041 Aug 24 09:00:33.956745 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 269/550] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:33 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:34.206962 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9ea93447-feb5-4ce2-9e69-ad517b000cc9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:34.207885 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9ea93447-feb5-4ce2-9e69-ad517b000cc9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:34.217326 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9ea93447-feb5-4ce2-9e69-ad517b000cc9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:34.218066 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9ea93447-feb5-4ce2-9e69-ad517b000cc9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:34.218705 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9ea93447-feb5-4ce2-9e69-ad517b000cc9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:34.219290 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d2727ddb-c743-47eb-a387-751b874b142d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:34.219711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9ea93447-feb5-4ce2-9e69-ad517b000cc9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:34.220055 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d2727ddb-c743-47eb-a387-751b874b142d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:34.220401 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9ea93447-feb5-4ce2-9e69-ad517b000cc9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:34.220911 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9ea93447-feb5-4ce2-9e69-ad517b000cc9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:34.227515 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d2727ddb-c743-47eb-a387-751b874b142d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:34.228213 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d2727ddb-c743-47eb-a387-751b874b142d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:34.228806 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d2727ddb-c743-47eb-a387-751b874b142d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:34.229713 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d2727ddb-c743-47eb-a387-751b874b142d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:34.231053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d2727ddb-c743-47eb-a387-751b874b142d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:34.231815 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d2727ddb-c743-47eb-a387-751b874b142d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:34.329238 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9ea93447-feb5-4ce2-9e69-ad517b000cc9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:34.352500 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9ea93447-feb5-4ce2-9e69-ad517b000cc9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1245 microversion: 2.1 time: 0.150370 Aug 24 09:00:34.353783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 282/551] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:34 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1245 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:34.423307 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d2727ddb-c743-47eb-a387-751b874b142d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:34.433253 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d2727ddb-c743-47eb-a387-751b874b142d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:34.434867 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d2727ddb-c743-47eb-a387-751b874b142d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:34.436239 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d2727ddb-c743-47eb-a387-751b874b142d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.223282 Aug 24 09:00:34.436834 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 270/552] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:34 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:34.987728 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-55a9dd2b-12f6-42cd-acc8-867ef9ef0eff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:34.988382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-55a9dd2b-12f6-42cd-acc8-867ef9ef0eff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:34.997928 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-55a9dd2b-12f6-42cd-acc8-867ef9ef0eff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:34.998723 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-55a9dd2b-12f6-42cd-acc8-867ef9ef0eff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:34.999764 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-55a9dd2b-12f6-42cd-acc8-867ef9ef0eff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:35.000953 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-55a9dd2b-12f6-42cd-acc8-867ef9ef0eff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:35.001933 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-55a9dd2b-12f6-42cd-acc8-867ef9ef0eff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:35.002995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-55a9dd2b-12f6-42cd-acc8-867ef9ef0eff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:35.208368 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-55a9dd2b-12f6-42cd-acc8-867ef9ef0eff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:35.222854 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-55a9dd2b-12f6-42cd-acc8-867ef9ef0eff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.240208 Aug 24 09:00:35.223771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 283/553] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:34 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:35.387904 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c24e4395-7197-421e-9026-cb9167b78952 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:35.393107 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c24e4395-7197-421e-9026-cb9167b78952 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:35.401286 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c24e4395-7197-421e-9026-cb9167b78952 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:35.402573 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c24e4395-7197-421e-9026-cb9167b78952 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:35.403383 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c24e4395-7197-421e-9026-cb9167b78952 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:35.407043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c24e4395-7197-421e-9026-cb9167b78952 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:35.408644 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c24e4395-7197-421e-9026-cb9167b78952 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:35.410497 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c24e4395-7197-421e-9026-cb9167b78952 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:35.467586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-37d06e96-ab3a-4ad8-8010-e06be1f6ac1d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:35.468104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-37d06e96-ab3a-4ad8-8010-e06be1f6ac1d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:35.474890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-37d06e96-ab3a-4ad8-8010-e06be1f6ac1d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:35.475530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-37d06e96-ab3a-4ad8-8010-e06be1f6ac1d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:35.475969 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-37d06e96-ab3a-4ad8-8010-e06be1f6ac1d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:35.476804 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-37d06e96-ab3a-4ad8-8010-e06be1f6ac1d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:35.477434 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-37d06e96-ab3a-4ad8-8010-e06be1f6ac1d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:35.478020 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-37d06e96-ab3a-4ad8-8010-e06be1f6ac1d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:35.497476 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c24e4395-7197-421e-9026-cb9167b78952 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:35.507420 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c24e4395-7197-421e-9026-cb9167b78952 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1245 microversion: 2.1 time: 0.125851 Aug 24 09:00:35.508327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 271/554] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:35 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1245 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:35.737938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-37d06e96-ab3a-4ad8-8010-e06be1f6ac1d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:35.747478 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-37d06e96-ab3a-4ad8-8010-e06be1f6ac1d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:35.749086 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-37d06e96-ab3a-4ad8-8010-e06be1f6ac1d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:35.750395 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-37d06e96-ab3a-4ad8-8010-e06be1f6ac1d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.288103 Aug 24 09:00:35.751026 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 284/555] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:35 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:36.249366 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-55661160-6c59-4734-a494-4c5f6b2aa508 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:36.250853 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-55661160-6c59-4734-a494-4c5f6b2aa508 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:36.262238 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-55661160-6c59-4734-a494-4c5f6b2aa508 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:36.269674 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-55661160-6c59-4734-a494-4c5f6b2aa508 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:36.269674 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-55661160-6c59-4734-a494-4c5f6b2aa508 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:36.269674 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-55661160-6c59-4734-a494-4c5f6b2aa508 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:36.269674 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-55661160-6c59-4734-a494-4c5f6b2aa508 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:36.270317 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-55661160-6c59-4734-a494-4c5f6b2aa508 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:36.534257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-31183bfa-5fd2-439b-817e-8b45f1b50ba6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:36.535061 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-31183bfa-5fd2-439b-817e-8b45f1b50ba6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:36.544722 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-31183bfa-5fd2-439b-817e-8b45f1b50ba6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:36.546485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-31183bfa-5fd2-439b-817e-8b45f1b50ba6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:36.547883 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-31183bfa-5fd2-439b-817e-8b45f1b50ba6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:36.548904 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-31183bfa-5fd2-439b-817e-8b45f1b50ba6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:36.549368 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-31183bfa-5fd2-439b-817e-8b45f1b50ba6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:36.549794 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-31183bfa-5fd2-439b-817e-8b45f1b50ba6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:36.592032 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-55661160-6c59-4734-a494-4c5f6b2aa508 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:36.609537 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-55661160-6c59-4734-a494-4c5f6b2aa508 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.367443 Aug 24 09:00:36.610580 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 272/556] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:36 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:36.628403 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-31183bfa-5fd2-439b-817e-8b45f1b50ba6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:36.643411 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-31183bfa-5fd2-439b-817e-8b45f1b50ba6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1245 microversion: 2.1 time: 0.116121 Aug 24 09:00:36.644491 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 285/557] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:36 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1245 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:36.775133 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0a58bc54-0c21-4057-b0fd-f1fccd8c4951 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:36.776815 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0a58bc54-0c21-4057-b0fd-f1fccd8c4951 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:36.782542 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0a58bc54-0c21-4057-b0fd-f1fccd8c4951 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:36.783027 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0a58bc54-0c21-4057-b0fd-f1fccd8c4951 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:36.783473 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0a58bc54-0c21-4057-b0fd-f1fccd8c4951 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:36.784365 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0a58bc54-0c21-4057-b0fd-f1fccd8c4951 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:36.784877 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0a58bc54-0c21-4057-b0fd-f1fccd8c4951 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:36.785306 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0a58bc54-0c21-4057-b0fd-f1fccd8c4951 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:36.989760 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0a58bc54-0c21-4057-b0fd-f1fccd8c4951 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:37.004115 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0a58bc54-0c21-4057-b0fd-f1fccd8c4951 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:37.005744 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0a58bc54-0c21-4057-b0fd-f1fccd8c4951 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:37.007144 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0a58bc54-0c21-4057-b0fd-f1fccd8c4951 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.235933 Aug 24 09:00:37.007595 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 273/558] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:36 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:37.631621 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-71f66eac-6f69-4715-86ba-78bbbd67b2b6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:37.632366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-71f66eac-6f69-4715-86ba-78bbbd67b2b6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:37.639741 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-71f66eac-6f69-4715-86ba-78bbbd67b2b6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:37.640310 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-71f66eac-6f69-4715-86ba-78bbbd67b2b6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:37.640859 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-71f66eac-6f69-4715-86ba-78bbbd67b2b6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:37.641750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-71f66eac-6f69-4715-86ba-78bbbd67b2b6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:37.642206 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-71f66eac-6f69-4715-86ba-78bbbd67b2b6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:37.642706 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-71f66eac-6f69-4715-86ba-78bbbd67b2b6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:37.684510 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-389a24b2-6c2c-4e12-8500-0fdf85acfb78 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:37.686283 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-389a24b2-6c2c-4e12-8500-0fdf85acfb78 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:37.698988 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-389a24b2-6c2c-4e12-8500-0fdf85acfb78 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:37.699867 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-389a24b2-6c2c-4e12-8500-0fdf85acfb78 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:37.700672 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-389a24b2-6c2c-4e12-8500-0fdf85acfb78 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:37.701948 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-389a24b2-6c2c-4e12-8500-0fdf85acfb78 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:37.702786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-389a24b2-6c2c-4e12-8500-0fdf85acfb78 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:37.703752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-389a24b2-6c2c-4e12-8500-0fdf85acfb78 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:37.825276 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-389a24b2-6c2c-4e12-8500-0fdf85acfb78 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:37.850765 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-389a24b2-6c2c-4e12-8500-0fdf85acfb78 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1245 microversion: 2.1 time: 0.173343 Aug 24 09:00:37.852485 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 274/559] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:37 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1245 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:37.886151 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-71f66eac-6f69-4715-86ba-78bbbd67b2b6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:37.893150 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-71f66eac-6f69-4715-86ba-78bbbd67b2b6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.265184 Aug 24 09:00:37.894094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 286/560] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:37 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:38.032512 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a3e3d48f-1715-45a4-a670-7595523ba933 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:38.033346 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a3e3d48f-1715-45a4-a670-7595523ba933 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:38.039880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a3e3d48f-1715-45a4-a670-7595523ba933 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:38.040472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a3e3d48f-1715-45a4-a670-7595523ba933 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:38.041013 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a3e3d48f-1715-45a4-a670-7595523ba933 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:38.041844 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a3e3d48f-1715-45a4-a670-7595523ba933 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:38.042397 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a3e3d48f-1715-45a4-a670-7595523ba933 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:38.043041 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a3e3d48f-1715-45a4-a670-7595523ba933 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:38.254768 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a3e3d48f-1715-45a4-a670-7595523ba933 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:38.270669 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a3e3d48f-1715-45a4-a670-7595523ba933 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:38.274144 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a3e3d48f-1715-45a4-a670-7595523ba933 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:38.277469 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a3e3d48f-1715-45a4-a670-7595523ba933 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.250293 Aug 24 09:00:38.279658 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 275/561] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:38 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:38.879059 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3d8dd177-b306-455e-9b0c-cf9a2db4cc08 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:38.880243 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3d8dd177-b306-455e-9b0c-cf9a2db4cc08 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:38.891716 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d8dd177-b306-455e-9b0c-cf9a2db4cc08 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:38.892470 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d8dd177-b306-455e-9b0c-cf9a2db4cc08 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:38.893206 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d8dd177-b306-455e-9b0c-cf9a2db4cc08 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:38.894327 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d8dd177-b306-455e-9b0c-cf9a2db4cc08 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:38.895173 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d8dd177-b306-455e-9b0c-cf9a2db4cc08 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:38.896018 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d8dd177-b306-455e-9b0c-cf9a2db4cc08 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:38.923135 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b6c7bc04-3d4d-4a04-8a55-724b4ca1215d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:38.929416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b6c7bc04-3d4d-4a04-8a55-724b4ca1215d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:38.953635 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b6c7bc04-3d4d-4a04-8a55-724b4ca1215d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:38.954204 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b6c7bc04-3d4d-4a04-8a55-724b4ca1215d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:38.954924 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b6c7bc04-3d4d-4a04-8a55-724b4ca1215d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:38.956181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b6c7bc04-3d4d-4a04-8a55-724b4ca1215d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:38.956968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b6c7bc04-3d4d-4a04-8a55-724b4ca1215d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:38.957678 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b6c7bc04-3d4d-4a04-8a55-724b4ca1215d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:39.026096 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3d8dd177-b306-455e-9b0c-cf9a2db4cc08 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:39.041725 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3d8dd177-b306-455e-9b0c-cf9a2db4cc08 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1237 microversion: 2.1 time: 0.168271 Aug 24 09:00:39.042817 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 287/562] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:38 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1237 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:39.153408 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b6c7bc04-3d4d-4a04-8a55-724b4ca1215d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:39.170290 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b6c7bc04-3d4d-4a04-8a55-724b4ca1215d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.257518 Aug 24 09:00:39.171533 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 276/563] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:38 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:39.310697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7025dbc0-9e91-41c6-83df-41b3ff3c4ee7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:39.312127 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7025dbc0-9e91-41c6-83df-41b3ff3c4ee7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:39.320048 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7025dbc0-9e91-41c6-83df-41b3ff3c4ee7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:39.320711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7025dbc0-9e91-41c6-83df-41b3ff3c4ee7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:39.321373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7025dbc0-9e91-41c6-83df-41b3ff3c4ee7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:39.322248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7025dbc0-9e91-41c6-83df-41b3ff3c4ee7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:39.322952 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7025dbc0-9e91-41c6-83df-41b3ff3c4ee7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:39.324133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7025dbc0-9e91-41c6-83df-41b3ff3c4ee7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:39.582121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7025dbc0-9e91-41c6-83df-41b3ff3c4ee7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:39.593831 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7025dbc0-9e91-41c6-83df-41b3ff3c4ee7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:39.595537 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7025dbc0-9e91-41c6-83df-41b3ff3c4ee7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:39.597129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7025dbc0-9e91-41c6-83df-41b3ff3c4ee7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1744 microversion: 2.20 time: 0.291868 Aug 24 09:00:39.600926 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 288/564] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:39 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1744 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:40.063935 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-46418eb0-bc92-4a52-a672-374ad896cc30 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:40.064576 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-46418eb0-bc92-4a52-a672-374ad896cc30 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:40.072909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-46418eb0-bc92-4a52-a672-374ad896cc30 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:40.073591 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-46418eb0-bc92-4a52-a672-374ad896cc30 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:40.074025 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-46418eb0-bc92-4a52-a672-374ad896cc30 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:40.074734 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-46418eb0-bc92-4a52-a672-374ad896cc30 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:40.075232 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-46418eb0-bc92-4a52-a672-374ad896cc30 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:40.075649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-46418eb0-bc92-4a52-a672-374ad896cc30 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:40.147205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-46418eb0-bc92-4a52-a672-374ad896cc30 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:40.156238 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-46418eb0-bc92-4a52-a672-374ad896cc30 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1293 microversion: 2.1 time: 0.096609 Aug 24 09:00:40.156872 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 277/565] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:40 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:40.214859 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c6277751-5b7f-4d83-bd09-8f7c006945be tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:40.215639 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c6277751-5b7f-4d83-bd09-8f7c006945be tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:40.232124 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c6277751-5b7f-4d83-bd09-8f7c006945be tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:40.232581 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c6277751-5b7f-4d83-bd09-8f7c006945be tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:40.233037 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c6277751-5b7f-4d83-bd09-8f7c006945be tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:40.234110 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c6277751-5b7f-4d83-bd09-8f7c006945be tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:40.234605 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c6277751-5b7f-4d83-bd09-8f7c006945be tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:40.235184 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c6277751-5b7f-4d83-bd09-8f7c006945be tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:40.537392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c6277751-5b7f-4d83-bd09-8f7c006945be tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:40.556598 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c6277751-5b7f-4d83-bd09-8f7c006945be tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.355469 Aug 24 09:00:40.558098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 289/566] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:40 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:40.628961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-06e586c6-d783-4758-b397-98371bcd6410 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:40.630645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-06e586c6-d783-4758-b397-98371bcd6410 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:40.642753 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-06e586c6-d783-4758-b397-98371bcd6410 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:40.643545 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-06e586c6-d783-4758-b397-98371bcd6410 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:40.644195 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-06e586c6-d783-4758-b397-98371bcd6410 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:40.651187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-06e586c6-d783-4758-b397-98371bcd6410 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:40.651187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-06e586c6-d783-4758-b397-98371bcd6410 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:40.651187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-06e586c6-d783-4758-b397-98371bcd6410 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:40.913924 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-06e586c6-d783-4758-b397-98371bcd6410 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:40.925115 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-06e586c6-d783-4758-b397-98371bcd6410 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:40.927078 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-06e586c6-d783-4758-b397-98371bcd6410 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:40.929046 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-06e586c6-d783-4758-b397-98371bcd6410 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.308682 Aug 24 09:00:40.941778 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 278/567] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:40 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:41.099044 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b30ccd19-9b6d-4f3d-8df8-7d0da41ac3ae tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:41.116213 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b30ccd19-9b6d-4f3d-8df8-7d0da41ac3ae tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.116747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b30ccd19-9b6d-4f3d-8df8-7d0da41ac3ae tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.117186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b30ccd19-9b6d-4f3d-8df8-7d0da41ac3ae tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:41.177986 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-26715834-1d08-43d4-8c83-ea2ca82f3a69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:41.179227 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-26715834-1d08-43d4-8c83-ea2ca82f3a69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:41.187828 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-26715834-1d08-43d4-8c83-ea2ca82f3a69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.199948 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-26715834-1d08-43d4-8c83-ea2ca82f3a69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.200861 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-26715834-1d08-43d4-8c83-ea2ca82f3a69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:41.203092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-26715834-1d08-43d4-8c83-ea2ca82f3a69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.203753 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-26715834-1d08-43d4-8c83-ea2ca82f3a69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.210914 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-26715834-1d08-43d4-8c83-ea2ca82f3a69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:41.259296 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b30ccd19-9b6d-4f3d-8df8-7d0da41ac3ae tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Going to try to stop instance {{(pid=132984) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 09:00:41.395367 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-26715834-1d08-43d4-8c83-ea2ca82f3a69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:41.408469 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-26715834-1d08-43d4-8c83-ea2ca82f3a69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1301 microversion: 2.1 time: 0.234498 Aug 24 09:00:41.410800 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 279/568] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:41 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1301 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:41.581751 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8171ea4f-3493-4c93-a111-d6937cc97ac5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:41.582475 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8171ea4f-3493-4c93-a111-d6937cc97ac5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:41.592516 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b30ccd19-9b6d-4f3d-8df8-7d0da41ac3ae tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "POST /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/action" status: 202 len: 0 microversion: 2.1 time: 0.500878 Aug 24 09:00:41.594363 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 290/569] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 09:00:41 2022] POST /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:00:41.614900 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8171ea4f-3493-4c93-a111-d6937cc97ac5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.617396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8171ea4f-3493-4c93-a111-d6937cc97ac5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.618526 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8171ea4f-3493-4c93-a111-d6937cc97ac5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:41.622062 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8171ea4f-3493-4c93-a111-d6937cc97ac5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.625192 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8171ea4f-3493-4c93-a111-d6937cc97ac5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.629631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8171ea4f-3493-4c93-a111-d6937cc97ac5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:41.656412 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7ed9a4da-93e7-47b9-a5f2-35503696e7e8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:41.659556 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7ed9a4da-93e7-47b9-a5f2-35503696e7e8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:41.684687 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7ed9a4da-93e7-47b9-a5f2-35503696e7e8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.684687 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7ed9a4da-93e7-47b9-a5f2-35503696e7e8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.685542 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7ed9a4da-93e7-47b9-a5f2-35503696e7e8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:41.687737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7ed9a4da-93e7-47b9-a5f2-35503696e7e8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.688679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7ed9a4da-93e7-47b9-a5f2-35503696e7e8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.689622 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7ed9a4da-93e7-47b9-a5f2-35503696e7e8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:42.118030 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8171ea4f-3493-4c93-a111-d6937cc97ac5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:42.154149 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8171ea4f-3493-4c93-a111-d6937cc97ac5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.577571 Aug 24 09:00:42.157512 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 280/570] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:41 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:42.174685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6001112f-0148-4328-8f47-920c915adeff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:42.175315 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6001112f-0148-4328-8f47-920c915adeff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:42.179424 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7ed9a4da-93e7-47b9-a5f2-35503696e7e8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:42.214460 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6001112f-0148-4328-8f47-920c915adeff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:42.215344 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6001112f-0148-4328-8f47-920c915adeff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:42.215561 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6001112f-0148-4328-8f47-920c915adeff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:42.216092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6001112f-0148-4328-8f47-920c915adeff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:42.216569 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6001112f-0148-4328-8f47-920c915adeff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:42.218013 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7ed9a4da-93e7-47b9-a5f2-35503696e7e8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1720 microversion: 2.1 time: 0.612122 Aug 24 09:00:42.222050 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 291/571] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:41 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1720 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:42.243334 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6001112f-0148-4328-8f47-920c915adeff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:42.261309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:42.444971 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6abe8138-dda0-44b5-8f07-12ab3c537971 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:42.445491 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6abe8138-dda0-44b5-8f07-12ab3c537971 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:42.456584 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6abe8138-dda0-44b5-8f07-12ab3c537971 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:42.457100 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6abe8138-dda0-44b5-8f07-12ab3c537971 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:42.457544 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6abe8138-dda0-44b5-8f07-12ab3c537971 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:42.458280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6abe8138-dda0-44b5-8f07-12ab3c537971 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:42.458789 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6abe8138-dda0-44b5-8f07-12ab3c537971 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:42.476143 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6abe8138-dda0-44b5-8f07-12ab3c537971 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:42.664354 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6001112f-0148-4328-8f47-920c915adeff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:42.758896 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6abe8138-dda0-44b5-8f07-12ab3c537971 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:42.772219 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6abe8138-dda0-44b5-8f07-12ab3c537971 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1299 microversion: 2.1 time: 0.340956 Aug 24 09:00:42.782579 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 292/572] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:42 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1299 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:42.800367 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fb098147-0019-470a-878b-9b6a14a25eb0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:42.801543 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fb098147-0019-470a-878b-9b6a14a25eb0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:42.805891 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6001112f-0148-4328-8f47-920c915adeff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:42.808273 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6001112f-0148-4328-8f47-920c915adeff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:42.815757 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fb098147-0019-470a-878b-9b6a14a25eb0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:42.818961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fb098147-0019-470a-878b-9b6a14a25eb0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:42.828961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fb098147-0019-470a-878b-9b6a14a25eb0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:42.828961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fb098147-0019-470a-878b-9b6a14a25eb0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:42.828961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fb098147-0019-470a-878b-9b6a14a25eb0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:42.828961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fb098147-0019-470a-878b-9b6a14a25eb0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:42.829429 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6001112f-0148-4328-8f47-920c915adeff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.652476 Aug 24 09:00:42.829429 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 281/573] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:42 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:42.933845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fb098147-0019-470a-878b-9b6a14a25eb0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Going to try to terminate instance {{(pid=132984) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:00:43.192251 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-81f465d7-82f5-4d56-b0c5-cac75949615b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:43.193432 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-81f465d7-82f5-4d56-b0c5-cac75949615b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:43.217057 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-81f465d7-82f5-4d56-b0c5-cac75949615b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:43.220569 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-81f465d7-82f5-4d56-b0c5-cac75949615b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:43.226880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-81f465d7-82f5-4d56-b0c5-cac75949615b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:43.227929 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-81f465d7-82f5-4d56-b0c5-cac75949615b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:43.228408 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-81f465d7-82f5-4d56-b0c5-cac75949615b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:43.228885 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-81f465d7-82f5-4d56-b0c5-cac75949615b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:43.614259 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fb098147-0019-470a-878b-9b6a14a25eb0 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 204 len: 0 microversion: 2.1 time: 0.824547 Aug 24 09:00:43.615181 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 293/574] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:00:42 2022] DELETE /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 09:00:43.637435 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a2fb9d9f-4613-43ff-a3f6-ee75a5771c6c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:43.638436 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a2fb9d9f-4613-43ff-a3f6-ee75a5771c6c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:43.654639 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2fb9d9f-4613-43ff-a3f6-ee75a5771c6c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:43.655398 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2fb9d9f-4613-43ff-a3f6-ee75a5771c6c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:43.655837 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2fb9d9f-4613-43ff-a3f6-ee75a5771c6c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:43.656583 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2fb9d9f-4613-43ff-a3f6-ee75a5771c6c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:43.657043 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2fb9d9f-4613-43ff-a3f6-ee75a5771c6c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:43.659197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2fb9d9f-4613-43ff-a3f6-ee75a5771c6c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:43.703278 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-81f465d7-82f5-4d56-b0c5-cac75949615b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:43.716147 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-81f465d7-82f5-4d56-b0c5-cac75949615b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.528296 Aug 24 09:00:43.721768 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 282/575] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:43 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:43.742890 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-58bb6897-2b75-403d-94f8-80e9111de969 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:43.743758 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-58bb6897-2b75-403d-94f8-80e9111de969 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:43.751177 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-58bb6897-2b75-403d-94f8-80e9111de969 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:43.751995 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-58bb6897-2b75-403d-94f8-80e9111de969 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:43.752696 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-58bb6897-2b75-403d-94f8-80e9111de969 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:43.753789 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-58bb6897-2b75-403d-94f8-80e9111de969 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:43.754453 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-58bb6897-2b75-403d-94f8-80e9111de969 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:43.755041 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-58bb6897-2b75-403d-94f8-80e9111de969 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:43.958428 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-58bb6897-2b75-403d-94f8-80e9111de969 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:43.970211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-58bb6897-2b75-403d-94f8-80e9111de969 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1514 microversion: 2.1 time: 0.247070 Aug 24 09:00:43.971493 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 283/576] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:43 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:43.986385 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-aec7ca14-e493-4d7b-9226-8c24255bff44 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:43.987719 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-aec7ca14-e493-4d7b-9226-8c24255bff44 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:43.995517 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aec7ca14-e493-4d7b-9226-8c24255bff44 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:43.996396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aec7ca14-e493-4d7b-9226-8c24255bff44 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:43.997684 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aec7ca14-e493-4d7b-9226-8c24255bff44 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:43.998626 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aec7ca14-e493-4d7b-9226-8c24255bff44 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:43.999206 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aec7ca14-e493-4d7b-9226-8c24255bff44 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:43.999901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aec7ca14-e493-4d7b-9226-8c24255bff44 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:44.172661 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a2fb9d9f-4613-43ff-a3f6-ee75a5771c6c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:44.185654 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a2fb9d9f-4613-43ff-a3f6-ee75a5771c6c tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1720 microversion: 2.1 time: 0.564141 Aug 24 09:00:44.186558 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 294/577] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:43 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1720 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:44.193364 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-aa38e93d-f050-46a8-b906-39594636b941 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:44.203064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-aa38e93d-f050-46a8-b906-39594636b941 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:44.210855 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aa38e93d-f050-46a8-b906-39594636b941 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:44.211358 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aa38e93d-f050-46a8-b906-39594636b941 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:44.211803 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aa38e93d-f050-46a8-b906-39594636b941 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:44.212587 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aa38e93d-f050-46a8-b906-39594636b941 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:44.213064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aa38e93d-f050-46a8-b906-39594636b941 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:44.224233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aa38e93d-f050-46a8-b906-39594636b941 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:44.235197 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-aec7ca14-e493-4d7b-9226-8c24255bff44 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:44.246871 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-aec7ca14-e493-4d7b-9226-8c24255bff44 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.274024 Aug 24 09:00:44.247468 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 284/578] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:43 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:44.740915 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0da292bb-c764-4469-9fa7-6d5a03750ed7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:44.741584 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0da292bb-c764-4469-9fa7-6d5a03750ed7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:44.759459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0da292bb-c764-4469-9fa7-6d5a03750ed7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:44.765051 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0da292bb-c764-4469-9fa7-6d5a03750ed7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:44.767173 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0da292bb-c764-4469-9fa7-6d5a03750ed7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:44.770953 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0da292bb-c764-4469-9fa7-6d5a03750ed7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:44.771704 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0da292bb-c764-4469-9fa7-6d5a03750ed7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:44.772305 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0da292bb-c764-4469-9fa7-6d5a03750ed7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:44.776118 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-aa38e93d-f050-46a8-b906-39594636b941 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:44.780225 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:44.788571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-aa38e93d-f050-46a8-b906-39594636b941 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:44.791454 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-aa38e93d-f050-46a8-b906-39594636b941 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:44.792791 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-aa38e93d-f050-46a8-b906-39594636b941 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.603102 Aug 24 09:00:44.793661 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 295/579] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:44 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:44.999451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-582e0229-bb79-441e-b498-3843c483d654 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:45.000118 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-582e0229-bb79-441e-b498-3843c483d654 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:45.018358 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-582e0229-bb79-441e-b498-3843c483d654 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:45.021089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-582e0229-bb79-441e-b498-3843c483d654 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:45.021785 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-582e0229-bb79-441e-b498-3843c483d654 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:45.024148 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-582e0229-bb79-441e-b498-3843c483d654 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:45.025612 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-582e0229-bb79-441e-b498-3843c483d654 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:45.029643 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-582e0229-bb79-441e-b498-3843c483d654 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:45.049567 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0da292bb-c764-4469-9fa7-6d5a03750ed7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:45.063427 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0da292bb-c764-4469-9fa7-6d5a03750ed7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1277 microversion: 2.1 time: 0.326207 Aug 24 09:00:45.079759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 285/580] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:44 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1277 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:45.466982 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-582e0229-bb79-441e-b498-3843c483d654 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:45.482517 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-582e0229-bb79-441e-b498-3843c483d654 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1514 microversion: 2.1 time: 0.490329 Aug 24 09:00:45.483355 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 296/581] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:44 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1514 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:45.497916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-498ad69b-372e-4a38-bae8-f6df851f5727 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:45.500063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-498ad69b-372e-4a38-bae8-f6df851f5727 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:45.514790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-498ad69b-372e-4a38-bae8-f6df851f5727 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:45.517229 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-498ad69b-372e-4a38-bae8-f6df851f5727 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:45.517749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-498ad69b-372e-4a38-bae8-f6df851f5727 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:45.520777 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-498ad69b-372e-4a38-bae8-f6df851f5727 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:45.525318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-498ad69b-372e-4a38-bae8-f6df851f5727 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:45.526028 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-498ad69b-372e-4a38-bae8-f6df851f5727 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:45.585614 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b1b67c38-fcda-44dc-9433-10410480ef29 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:45.586849 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b1b67c38-fcda-44dc-9433-10410480ef29 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:45.607597 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b1b67c38-fcda-44dc-9433-10410480ef29 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:45.608747 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b1b67c38-fcda-44dc-9433-10410480ef29 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:45.609849 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b1b67c38-fcda-44dc-9433-10410480ef29 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:45.613181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b1b67c38-fcda-44dc-9433-10410480ef29 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:45.613947 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b1b67c38-fcda-44dc-9433-10410480ef29 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:45.614536 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b1b67c38-fcda-44dc-9433-10410480ef29 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:45.940300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b1b67c38-fcda-44dc-9433-10410480ef29 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:45.949665 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b1b67c38-fcda-44dc-9433-10410480ef29 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1720 microversion: 2.1 time: 0.743263 Aug 24 09:00:45.951355 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 286/582] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:45 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1720 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:45.956874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-19c411fc-4fd0-4d92-a3fb-ad34b565257c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:45.957709 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-19c411fc-4fd0-4d92-a3fb-ad34b565257c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:45.972018 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-19c411fc-4fd0-4d92-a3fb-ad34b565257c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:45.978844 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-19c411fc-4fd0-4d92-a3fb-ad34b565257c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:45.982277 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-19c411fc-4fd0-4d92-a3fb-ad34b565257c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:45.983218 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-19c411fc-4fd0-4d92-a3fb-ad34b565257c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:45.983690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-19c411fc-4fd0-4d92-a3fb-ad34b565257c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:45.984121 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-19c411fc-4fd0-4d92-a3fb-ad34b565257c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:46.598129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-19c411fc-4fd0-4d92-a3fb-ad34b565257c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:46.616629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-19c411fc-4fd0-4d92-a3fb-ad34b565257c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:46.619471 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-19c411fc-4fd0-4d92-a3fb-ad34b565257c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:46.621593 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-19c411fc-4fd0-4d92-a3fb-ad34b565257c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.668982 Aug 24 09:00:46.641433 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 287/583] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:45 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:46.654390 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b68d713a-b460-4bfc-9c17-7c4c49364f55 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:46.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b68d713a-b460-4bfc-9c17-7c4c49364f55 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:46.677139 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b68d713a-b460-4bfc-9c17-7c4c49364f55 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:46.681627 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b68d713a-b460-4bfc-9c17-7c4c49364f55 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:46.682309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b68d713a-b460-4bfc-9c17-7c4c49364f55 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:46.683750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b68d713a-b460-4bfc-9c17-7c4c49364f55 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:46.689035 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b68d713a-b460-4bfc-9c17-7c4c49364f55 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:46.690004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b68d713a-b460-4bfc-9c17-7c4c49364f55 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:46.814533 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-498ad69b-372e-4a38-bae8-f6df851f5727 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:46.829060 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-498ad69b-372e-4a38-bae8-f6df851f5727 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 1.341596 Aug 24 09:00:46.830285 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 297/584] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:45 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:46.835996 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b303faa4-1320-459a-91f0-019a1fe3abe4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:46.836984 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b303faa4-1320-459a-91f0-019a1fe3abe4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:46.851141 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b303faa4-1320-459a-91f0-019a1fe3abe4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:46.852431 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b303faa4-1320-459a-91f0-019a1fe3abe4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:46.853139 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b303faa4-1320-459a-91f0-019a1fe3abe4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:46.857294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b303faa4-1320-459a-91f0-019a1fe3abe4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:46.857997 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b303faa4-1320-459a-91f0-019a1fe3abe4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:46.859249 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b303faa4-1320-459a-91f0-019a1fe3abe4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:47.098648 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b68d713a-b460-4bfc-9c17-7c4c49364f55 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:47.124682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b68d713a-b460-4bfc-9c17-7c4c49364f55 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 0.467353 Aug 24 09:00:47.124682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 288/585] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:46 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:47.137423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-44e89f30-20e8-4457-8032-a5351f86a4cd tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:47.140561 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-44e89f30-20e8-4457-8032-a5351f86a4cd tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:47.149563 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-44e89f30-20e8-4457-8032-a5351f86a4cd tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:47.150314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-44e89f30-20e8-4457-8032-a5351f86a4cd tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:47.152131 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-44e89f30-20e8-4457-8032-a5351f86a4cd tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:47.153201 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-44e89f30-20e8-4457-8032-a5351f86a4cd tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:47.153886 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-44e89f30-20e8-4457-8032-a5351f86a4cd tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:47.154479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-44e89f30-20e8-4457-8032-a5351f86a4cd tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:47.254440 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b303faa4-1320-459a-91f0-019a1fe3abe4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:47.267657 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b303faa4-1320-459a-91f0-019a1fe3abe4 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1514 microversion: 2.1 time: 0.435960 Aug 24 09:00:47.270954 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 298/586] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:46 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1514 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:47.488154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-44e89f30-20e8-4457-8032-a5351f86a4cd tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:47.503091 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-44e89f30-20e8-4457-8032-a5351f86a4cd tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1720 microversion: 2.1 time: 0.388799 Aug 24 09:00:47.509668 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 289/587] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:47 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1720 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:47.526641 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-3caad341-c882-4cd8-ad89-2d4b3c635b2c req-aae499d8-2c47-4d68-9982-b19ec68e06ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5", "name": "network-vif-deleted", "tag": "0334fdf9-0a87-442a-a0c9-7fc944c76ef3"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:47.538811 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-3caad341-c882-4cd8-ad89-2d4b3c635b2c req-aae499d8-2c47-4d68-9982-b19ec68e06ef service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:47.539828 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-3caad341-c882-4cd8-ad89-2d4b3c635b2c req-aae499d8-2c47-4d68-9982-b19ec68e06ef service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:47.540570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-3caad341-c882-4cd8-ad89-2d4b3c635b2c req-aae499d8-2c47-4d68-9982-b19ec68e06ef service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:47.587471 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-3caad341-c882-4cd8-ad89-2d4b3c635b2c req-aae499d8-2c47-4d68-9982-b19ec68e06ef service nova] Creating event network-vif-deleted:0334fdf9-0a87-442a-a0c9-7fc944c76ef3 for instance e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 on hv-cinder-85221 Aug 24 09:00:47.596958 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-3caad341-c882-4cd8-ad89-2d4b3c635b2c req-aae499d8-2c47-4d68-9982-b19ec68e06ef service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078763 Aug 24 09:00:47.599351 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 299/588] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:47.853596 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b3424847-3bc6-4285-974e-63ef4c64493a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:47.854747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b3424847-3bc6-4285-974e-63ef4c64493a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:47.868377 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2c1fdde8-1489-4365-b44d-d48fe6789cd2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:47.882679 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2c1fdde8-1489-4365-b44d-d48fe6789cd2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:47.905602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b3424847-3bc6-4285-974e-63ef4c64493a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:47.906098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b3424847-3bc6-4285-974e-63ef4c64493a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:47.906534 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b3424847-3bc6-4285-974e-63ef4c64493a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:47.909138 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c1fdde8-1489-4365-b44d-d48fe6789cd2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:47.909634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c1fdde8-1489-4365-b44d-d48fe6789cd2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:47.910071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c1fdde8-1489-4365-b44d-d48fe6789cd2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:47.910793 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c1fdde8-1489-4365-b44d-d48fe6789cd2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:47.911249 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c1fdde8-1489-4365-b44d-d48fe6789cd2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:47.911670 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c1fdde8-1489-4365-b44d-d48fe6789cd2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:47.917477 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b3424847-3bc6-4285-974e-63ef4c64493a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:47.918091 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b3424847-3bc6-4285-974e-63ef4c64493a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:47.918701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b3424847-3bc6-4285-974e-63ef4c64493a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.155213 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2c1fdde8-1489-4365-b44d-d48fe6789cd2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:48.192709 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2c1fdde8-1489-4365-b44d-d48fe6789cd2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:48.195611 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2c1fdde8-1489-4365-b44d-d48fe6789cd2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:48.196907 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2c1fdde8-1489-4365-b44d-d48fe6789cd2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.543359 Aug 24 09:00:48.218552 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 290/589] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:47 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:48.223817 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-62422a45-a3bc-44ea-a594-dd0af14b334f req-a19083d1-df70-490a-8261-f72e24dfa4fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "713b8af9-0654-40a5-bae9-0592267a0458", "tag": "a8514a53-9b36-48eb-9c4f-354a332273c4"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:48.253267 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=87 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:48.271933 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-62422a45-a3bc-44ea-a594-dd0af14b334f req-a19083d1-df70-490a-8261-f72e24dfa4fc service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.272597 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-62422a45-a3bc-44ea-a594-dd0af14b334f req-a19083d1-df70-490a-8261-f72e24dfa4fc service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.273093 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-62422a45-a3bc-44ea-a594-dd0af14b334f req-a19083d1-df70-490a-8261-f72e24dfa4fc service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.307008 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-62422a45-a3bc-44ea-a594-dd0af14b334f req-a19083d1-df70-490a-8261-f72e24dfa4fc service nova] Creating event network-changed:a8514a53-9b36-48eb-9c4f-354a332273c4 for instance 713b8af9-0654-40a5-bae9-0592267a0458 on hv-cinder-85221 Aug 24 09:00:48.319703 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-62422a45-a3bc-44ea-a594-dd0af14b334f req-a19083d1-df70-490a-8261-f72e24dfa4fc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098584 Aug 24 09:00:48.319703 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 291/590] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:48.345906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7282ace3-6f96-40c7-a42b-72ffd83e17aa tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:48.345906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-7282ace3-6f96-40c7-a42b-72ffd83e17aa tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:48.365203 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7282ace3-6f96-40c7-a42b-72ffd83e17aa tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.365770 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7282ace3-6f96-40c7-a42b-72ffd83e17aa tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.366270 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7282ace3-6f96-40c7-a42b-72ffd83e17aa tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.367086 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7282ace3-6f96-40c7-a42b-72ffd83e17aa tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.367639 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7282ace3-6f96-40c7-a42b-72ffd83e17aa tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.368080 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7282ace3-6f96-40c7-a42b-72ffd83e17aa tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.548444 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b3424847-3bc6-4285-974e-63ef4c64493a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:48.560489 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b3424847-3bc6-4285-974e-63ef4c64493a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.712790 Aug 24 09:00:48.565339 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 300/591] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:47 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:48.582287 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:48.583156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:48.602331 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.603100 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.603685 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.605553 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.606170 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.606883 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.646569 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7282ace3-6f96-40c7-a42b-72ffd83e17aa tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:48.667202 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7282ace3-6f96-40c7-a42b-72ffd83e17aa tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 0.345891 Aug 24 09:00:48.686523 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 292/592] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:48 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:48.692456 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-108c04fc-68d4-4342-9f55-2481bfd3b51b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:48.703698 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-108c04fc-68d4-4342-9f55-2481bfd3b51b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:48.711858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-108c04fc-68d4-4342-9f55-2481bfd3b51b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.712522 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-108c04fc-68d4-4342-9f55-2481bfd3b51b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.712978 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-108c04fc-68d4-4342-9f55-2481bfd3b51b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.713714 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-108c04fc-68d4-4342-9f55-2481bfd3b51b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.717339 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-108c04fc-68d4-4342-9f55-2481bfd3b51b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.718025 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-108c04fc-68d4-4342-9f55-2481bfd3b51b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.726687 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.728932 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.729929 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.731192 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lazy-loading 'fault' on Instance uuid e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:00:48.989410 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f1ac1772b46d2a03165571edb6f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1977f516dfe40f7b26ffae80d68edd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:49.002664 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7fb6248c-874a-4749-ada0-e91544709c44 tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 200 len: 1309 microversion: 2.1 time: 0.429750 Aug 24 09:00:49.003282 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 301/593] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:48 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 1309 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:49.051896 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-108c04fc-68d4-4342-9f55-2481bfd3b51b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:49.063491 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-108c04fc-68d4-4342-9f55-2481bfd3b51b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1720 microversion: 2.1 time: 0.375693 Aug 24 09:00:49.064710 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 293/594] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:48 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1720 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:49.227483 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d2ae5600-3b30-4561-af48-93eccb991757 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:49.228417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d2ae5600-3b30-4561-af48-93eccb991757 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:49.243308 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d2ae5600-3b30-4561-af48-93eccb991757 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:49.247875 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d2ae5600-3b30-4561-af48-93eccb991757 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:49.248574 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d2ae5600-3b30-4561-af48-93eccb991757 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:49.251173 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d2ae5600-3b30-4561-af48-93eccb991757 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:49.251898 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d2ae5600-3b30-4561-af48-93eccb991757 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:49.260161 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d2ae5600-3b30-4561-af48-93eccb991757 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:49.593398 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-737b7718-d321-4459-bba3-09b59c92a2ba tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:49.595011 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-737b7718-d321-4459-bba3-09b59c92a2ba tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:49.620307 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-737b7718-d321-4459-bba3-09b59c92a2ba tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:49.621256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-737b7718-d321-4459-bba3-09b59c92a2ba tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:49.623560 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-737b7718-d321-4459-bba3-09b59c92a2ba tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:49.633847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-737b7718-d321-4459-bba3-09b59c92a2ba tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:49.634590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-737b7718-d321-4459-bba3-09b59c92a2ba tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:49.639269 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-737b7718-d321-4459-bba3-09b59c92a2ba tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:49.932161 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-737b7718-d321-4459-bba3-09b59c92a2ba tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:49.944172 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-737b7718-d321-4459-bba3-09b59c92a2ba tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.355545 Aug 24 09:00:49.944799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 294/595] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:49 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:49.969913 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f5f07846-6baa-4a89-b061-750c1d536a16 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:49.970530 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f5f07846-6baa-4a89-b061-750c1d536a16 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:49.977135 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f5f07846-6baa-4a89-b061-750c1d536a16 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:49.977632 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f5f07846-6baa-4a89-b061-750c1d536a16 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:49.978075 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f5f07846-6baa-4a89-b061-750c1d536a16 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:49.978811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f5f07846-6baa-4a89-b061-750c1d536a16 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:49.979826 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f5f07846-6baa-4a89-b061-750c1d536a16 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:49.980261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f5f07846-6baa-4a89-b061-750c1d536a16 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:50.122526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d2ae5600-3b30-4561-af48-93eccb991757 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:50.143185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d2ae5600-3b30-4561-af48-93eccb991757 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:50.155937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d2ae5600-3b30-4561-af48-93eccb991757 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:50.161984 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d2ae5600-3b30-4561-af48-93eccb991757 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.936152 Aug 24 09:00:50.163396 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 302/596] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:49 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:50.188531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f5f07846-6baa-4a89-b061-750c1d536a16 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:50.193418 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-28a10bf2-5e39-427c-817a-9d6c1f2858ea tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:50.196595 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-28a10bf2-5e39-427c-817a-9d6c1f2858ea tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] [instance: e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:50.202127 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f5f07846-6baa-4a89-b061-750c1d536a16 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 0.237040 Aug 24 09:00:50.203406 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 295/597] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:49 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:50.211985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-28a10bf2-5e39-427c-817a-9d6c1f2858ea tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:50.212486 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-28a10bf2-5e39-427c-817a-9d6c1f2858ea tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:50.215295 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-28a10bf2-5e39-427c-817a-9d6c1f2858ea tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:50.216081 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-28a10bf2-5e39-427c-817a-9d6c1f2858ea tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:50.216565 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-28a10bf2-5e39-427c-817a-9d6c1f2858ea tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:50.216994 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-28a10bf2-5e39-427c-817a-9d6c1f2858ea tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:50.247077 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-28a10bf2-5e39-427c-817a-9d6c1f2858ea tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] HTTP exception thrown: Instance e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 could not be found. Aug 24 09:00:50.247384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f2ca54a3-022f-44f7-9de5-4822cc8d12b3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:50.248235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f2ca54a3-022f-44f7-9de5-4822cc8d12b3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-28a10bf2-5e39-427c-817a-9d6c1f2858ea tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Request method failure captured: Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 HTTP/1.1 Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBefeULVGsydQljZkJ0aKFSHw5uz5Z0xPs1wbzrL6AvydSqqkVHwwCylCwi-RcLizJ9KWaJgvysv_LwR26BU4OJS1NQpff-4SvAbv8kI2-1E5WZjS3TfWUBte75e6uM4hWWle15mOE4Bic47UAEh2aOnEmi4x0OB8yljrKw-fHBKn1Fw Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: c1977f516dfe40f7b26ffae80d68edd9 Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1406734534 Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:00:50.250089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:00:50.251938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c1977f516dfe40f7b26ffae80d68edd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c1977f516dfe40f7b26ffae80d68edd9", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c1977f516dfe40f7b26ffae80d68edd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c1977f516dfe40f7b26ffae80d68edd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:00:50.251938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-VolumesSnapshotTestJSON-1406734534 Aug 24 09:00:50.251938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: c1977f516dfe40f7b26ffae80d68edd9 Aug 24 09:00:50.251938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1406734534 Aug 24 09:00:50.251938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-VolumesSnapshotTestJSON-1406734534-project Aug 24 09:00:50.251938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:00:50.251938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:00:50.251938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: c11f1ac1772b46d2a03165571edb6f10 Aug 24 09:00:50.251938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-VolumesSnapshotTestJSON-1406734534-project Aug 24 09:00:50.251938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:00:50.251938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 could not be found. Aug 24 09:00:50.251938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': 'e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5'} Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 could not be found. Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:00:50.253087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 could not be found. Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 could not be found. Aug 24 09:00:50.254774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:00:50.257204 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-28a10bf2-5e39-427c-817a-9d6c1f2858ea tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] Returning 404 to user: Instance e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:00:50.257834 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f2ca54a3-022f-44f7-9de5-4822cc8d12b3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:50.259298 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-28a10bf2-5e39-427c-817a-9d6c1f2858ea tempest-VolumesSnapshotTestJSON-1406734534 tempest-VolumesSnapshotTestJSON-1406734534-project] 10.222.0.55 "GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5" status: 404 len: 111 microversion: 2.1 time: 0.079679 Aug 24 09:00:50.259986 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f2ca54a3-022f-44f7-9de5-4822cc8d12b3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:50.261120 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 303/598] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:50 2022] GET /compute/v2.1/servers/e4b6fcbe-6417-4daf-bf7c-6f1cddcf11c5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:00:50.261252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f2ca54a3-022f-44f7-9de5-4822cc8d12b3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:50.262138 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f2ca54a3-022f-44f7-9de5-4822cc8d12b3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:50.262847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f2ca54a3-022f-44f7-9de5-4822cc8d12b3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:50.273170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f2ca54a3-022f-44f7-9de5-4822cc8d12b3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:50.602316 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f2ca54a3-022f-44f7-9de5-4822cc8d12b3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:50.620126 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f2ca54a3-022f-44f7-9de5-4822cc8d12b3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1720 microversion: 2.1 time: 0.411237 Aug 24 09:00:50.629206 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 296/599] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:50 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1720 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:50.966841 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-61c5b49a-eb5e-4dd3-ab1c-95751df8fc6f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:50.967750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-61c5b49a-eb5e-4dd3-ab1c-95751df8fc6f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:50.973365 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:50.990978 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61c5b49a-eb5e-4dd3-ab1c-95751df8fc6f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:50.992311 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61c5b49a-eb5e-4dd3-ab1c-95751df8fc6f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:50.993015 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61c5b49a-eb5e-4dd3-ab1c-95751df8fc6f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:50.994483 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61c5b49a-eb5e-4dd3-ab1c-95751df8fc6f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:51.000672 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61c5b49a-eb5e-4dd3-ab1c-95751df8fc6f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:51.001767 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61c5b49a-eb5e-4dd3-ab1c-95751df8fc6f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:51.190596 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2f4dc39e-b715-4bd9-ab33-8e6421aca024 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:51.207950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2f4dc39e-b715-4bd9-ab33-8e6421aca024 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:51.225746 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2f4dc39e-b715-4bd9-ab33-8e6421aca024 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:51.225746 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2f4dc39e-b715-4bd9-ab33-8e6421aca024 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:51.225746 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2f4dc39e-b715-4bd9-ab33-8e6421aca024 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:51.227410 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2f4dc39e-b715-4bd9-ab33-8e6421aca024 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:51.227894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2f4dc39e-b715-4bd9-ab33-8e6421aca024 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:51.228329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2f4dc39e-b715-4bd9-ab33-8e6421aca024 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:51.306160 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-61c5b49a-eb5e-4dd3-ab1c-95751df8fc6f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:51.322584 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-61c5b49a-eb5e-4dd3-ab1c-95751df8fc6f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.361196 Aug 24 09:00:51.325058 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 304/600] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:50 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:51.337432 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-11e85562-7dd7-4fbb-8e94-3fc7aa24748d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:51.343393 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-11e85562-7dd7-4fbb-8e94-3fc7aa24748d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:51.362834 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11e85562-7dd7-4fbb-8e94-3fc7aa24748d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:51.363887 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11e85562-7dd7-4fbb-8e94-3fc7aa24748d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:51.365148 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11e85562-7dd7-4fbb-8e94-3fc7aa24748d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:51.377132 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11e85562-7dd7-4fbb-8e94-3fc7aa24748d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:51.381557 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11e85562-7dd7-4fbb-8e94-3fc7aa24748d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:51.384345 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11e85562-7dd7-4fbb-8e94-3fc7aa24748d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:51.682530 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2f4dc39e-b715-4bd9-ab33-8e6421aca024 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:51.703935 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2f4dc39e-b715-4bd9-ab33-8e6421aca024 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:51.707552 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2f4dc39e-b715-4bd9-ab33-8e6421aca024 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:51.730434 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2f4dc39e-b715-4bd9-ab33-8e6421aca024 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.542554 Aug 24 09:00:51.731264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 297/601] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:51 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:51.737807 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-67a91533-6295-4690-8843-9eae0b6703f1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:51.739104 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-67a91533-6295-4690-8843-9eae0b6703f1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:51.745780 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-11e85562-7dd7-4fbb-8e94-3fc7aa24748d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:51.749489 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67a91533-6295-4690-8843-9eae0b6703f1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:51.750336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67a91533-6295-4690-8843-9eae0b6703f1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:51.751053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67a91533-6295-4690-8843-9eae0b6703f1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:51.752098 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67a91533-6295-4690-8843-9eae0b6703f1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:51.752808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67a91533-6295-4690-8843-9eae0b6703f1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:51.753515 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67a91533-6295-4690-8843-9eae0b6703f1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:51.767009 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-11e85562-7dd7-4fbb-8e94-3fc7aa24748d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 0.440582 Aug 24 09:00:51.767609 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 305/602] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:51 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:51.796880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:52.047446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-67a91533-6295-4690-8843-9eae0b6703f1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:52.058948 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-67a91533-6295-4690-8843-9eae0b6703f1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1720 microversion: 2.1 time: 0.325959 Aug 24 09:00:52.062625 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 298/603] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:51 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1720 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:52.349515 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1e7d9f53-e792-4558-9317-ba6e0f23ff9e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:52.351094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1e7d9f53-e792-4558-9317-ba6e0f23ff9e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:52.363155 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1e7d9f53-e792-4558-9317-ba6e0f23ff9e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.363937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1e7d9f53-e792-4558-9317-ba6e0f23ff9e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.364667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1e7d9f53-e792-4558-9317-ba6e0f23ff9e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.365574 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1e7d9f53-e792-4558-9317-ba6e0f23ff9e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.366251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1e7d9f53-e792-4558-9317-ba6e0f23ff9e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.367089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1e7d9f53-e792-4558-9317-ba6e0f23ff9e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.729839 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1e7d9f53-e792-4558-9317-ba6e0f23ff9e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:52.750039 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1e7d9f53-e792-4558-9317-ba6e0f23ff9e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.408533 Aug 24 09:00:52.754251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 306/604] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:52 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:52.755964 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3486ceaf-2be9-4e75-a908-5cc9df549135 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:52.757166 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3486ceaf-2be9-4e75-a908-5cc9df549135 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:52.780858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3486ceaf-2be9-4e75-a908-5cc9df549135 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.782205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3486ceaf-2be9-4e75-a908-5cc9df549135 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.783079 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3486ceaf-2be9-4e75-a908-5cc9df549135 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.784700 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3486ceaf-2be9-4e75-a908-5cc9df549135 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.785684 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3486ceaf-2be9-4e75-a908-5cc9df549135 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.787801 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3486ceaf-2be9-4e75-a908-5cc9df549135 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.794680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7db4c7a3-0386-4b99-be48-2a9417184ec9 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:52.795584 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7db4c7a3-0386-4b99-be48-2a9417184ec9 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:52.807509 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7db4c7a3-0386-4b99-be48-2a9417184ec9 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.809060 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7db4c7a3-0386-4b99-be48-2a9417184ec9 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.810100 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7db4c7a3-0386-4b99-be48-2a9417184ec9 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.811671 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7db4c7a3-0386-4b99-be48-2a9417184ec9 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.812780 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7db4c7a3-0386-4b99-be48-2a9417184ec9 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.813771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7db4c7a3-0386-4b99-be48-2a9417184ec9 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:53.021791 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3486ceaf-2be9-4e75-a908-5cc9df549135 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:53.040814 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3486ceaf-2be9-4e75-a908-5cc9df549135 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:53.040814 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3486ceaf-2be9-4e75-a908-5cc9df549135 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:53.040814 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3486ceaf-2be9-4e75-a908-5cc9df549135 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.288309 Aug 24 09:00:53.041166 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 299/605] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:52 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:53.082365 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4446e80f-a499-48cc-a59d-9aa8c1e83072 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:53.083782 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4446e80f-a499-48cc-a59d-9aa8c1e83072 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:53.095261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4446e80f-a499-48cc-a59d-9aa8c1e83072 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:53.099294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4446e80f-a499-48cc-a59d-9aa8c1e83072 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:53.100019 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4446e80f-a499-48cc-a59d-9aa8c1e83072 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:53.104712 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4446e80f-a499-48cc-a59d-9aa8c1e83072 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:53.104712 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4446e80f-a499-48cc-a59d-9aa8c1e83072 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:53.104712 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4446e80f-a499-48cc-a59d-9aa8c1e83072 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:53.132878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7db4c7a3-0386-4b99-be48-2a9417184ec9 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:53.161117 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7db4c7a3-0386-4b99-be48-2a9417184ec9 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 0.373724 Aug 24 09:00:53.172991 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 307/606] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:52 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:53.319993 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4446e80f-a499-48cc-a59d-9aa8c1e83072 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:53.342871 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4446e80f-a499-48cc-a59d-9aa8c1e83072 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1720 microversion: 2.1 time: 0.266051 Aug 24 09:00:53.344175 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 300/607] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:53 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1720 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:53.778981 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e812f5bd-7dc6-4d89-b380-8ccda8a89fa3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:53.795692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e812f5bd-7dc6-4d89-b380-8ccda8a89fa3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:53.811432 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e812f5bd-7dc6-4d89-b380-8ccda8a89fa3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:53.812956 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e812f5bd-7dc6-4d89-b380-8ccda8a89fa3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:53.819996 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e812f5bd-7dc6-4d89-b380-8ccda8a89fa3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:53.819996 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e812f5bd-7dc6-4d89-b380-8ccda8a89fa3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:53.819996 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e812f5bd-7dc6-4d89-b380-8ccda8a89fa3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:53.819996 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e812f5bd-7dc6-4d89-b380-8ccda8a89fa3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:54.060853 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-92d8aa1d-d101-4deb-a9df-9f7e97900155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:54.064413 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-92d8aa1d-d101-4deb-a9df-9f7e97900155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:54.094102 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-92d8aa1d-d101-4deb-a9df-9f7e97900155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:54.095020 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-92d8aa1d-d101-4deb-a9df-9f7e97900155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:54.096139 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-92d8aa1d-d101-4deb-a9df-9f7e97900155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:54.098619 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-92d8aa1d-d101-4deb-a9df-9f7e97900155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:54.101372 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-92d8aa1d-d101-4deb-a9df-9f7e97900155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:54.102240 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-92d8aa1d-d101-4deb-a9df-9f7e97900155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:54.167558 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e812f5bd-7dc6-4d89-b380-8ccda8a89fa3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:54.184743 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e812f5bd-7dc6-4d89-b380-8ccda8a89fa3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.410501 Aug 24 09:00:54.186422 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 308/608] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:53 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:54.214329 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b5c5e333-5228-4b6d-a89d-0a55125c5236 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:54.215567 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b5c5e333-5228-4b6d-a89d-0a55125c5236 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:54.223335 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b5c5e333-5228-4b6d-a89d-0a55125c5236 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:54.227555 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b5c5e333-5228-4b6d-a89d-0a55125c5236 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:54.228083 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b5c5e333-5228-4b6d-a89d-0a55125c5236 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:54.228910 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b5c5e333-5228-4b6d-a89d-0a55125c5236 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:54.230211 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b5c5e333-5228-4b6d-a89d-0a55125c5236 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:54.231290 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b5c5e333-5228-4b6d-a89d-0a55125c5236 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:54.388412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-92d8aa1d-d101-4deb-a9df-9f7e97900155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:54.397025 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-92d8aa1d-d101-4deb-a9df-9f7e97900155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:54.398547 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-92d8aa1d-d101-4deb-a9df-9f7e97900155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:54.399745 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-92d8aa1d-d101-4deb-a9df-9f7e97900155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.343461 Aug 24 09:00:54.413017 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 301/609] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:54 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:54.419378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-43fe7fb7-0e9f-4006-8fb1-a04cfb74c666 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:54.420210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-43fe7fb7-0e9f-4006-8fb1-a04cfb74c666 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:54.427182 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-43fe7fb7-0e9f-4006-8fb1-a04cfb74c666 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:54.427669 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-43fe7fb7-0e9f-4006-8fb1-a04cfb74c666 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:54.428101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-43fe7fb7-0e9f-4006-8fb1-a04cfb74c666 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:54.428857 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-43fe7fb7-0e9f-4006-8fb1-a04cfb74c666 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:54.429519 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-43fe7fb7-0e9f-4006-8fb1-a04cfb74c666 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:54.430131 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-43fe7fb7-0e9f-4006-8fb1-a04cfb74c666 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:54.439891 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b5c5e333-5228-4b6d-a89d-0a55125c5236 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:54.451487 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b5c5e333-5228-4b6d-a89d-0a55125c5236 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 0.262469 Aug 24 09:00:54.488020 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 309/610] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:54 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:54.615798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-43fe7fb7-0e9f-4006-8fb1-a04cfb74c666 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:54.625532 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-43fe7fb7-0e9f-4006-8fb1-a04cfb74c666 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1697 microversion: 2.1 time: 0.211171 Aug 24 09:00:54.626297 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 302/611] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:54 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1697 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:54.646711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-16702a3d-d286-4db8-acf2-d7aa6e522923 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:54.658441 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16702a3d-d286-4db8-acf2-d7aa6e522923 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:54.658933 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16702a3d-d286-4db8-acf2-d7aa6e522923 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:54.718752 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16702a3d-d286-4db8-acf2-d7aa6e522923 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:54.718752 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-16702a3d-d286-4db8-acf2-d7aa6e522923 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Going to try to start instance {{(pid=132984) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 09:00:55.218550 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-16702a3d-d286-4db8-acf2-d7aa6e522923 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "POST /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/action" status: 202 len: 0 microversion: 2.1 time: 0.574655 Aug 24 09:00:55.220365 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 310/612] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 09:00:54 2022] POST /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:00:55.233530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-70668f12-ad0d-4756-82c7-10f3f8fc6ee7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:55.233793 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-01435956-e1ba-4505-b18a-448bde49ce81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:55.234381 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-01435956-e1ba-4505-b18a-448bde49ce81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:55.239011 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-70668f12-ad0d-4756-82c7-10f3f8fc6ee7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:55.253518 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-70668f12-ad0d-4756-82c7-10f3f8fc6ee7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:55.254401 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-70668f12-ad0d-4756-82c7-10f3f8fc6ee7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:55.255091 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-70668f12-ad0d-4756-82c7-10f3f8fc6ee7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:55.256163 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-70668f12-ad0d-4756-82c7-10f3f8fc6ee7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:55.256986 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-70668f12-ad0d-4756-82c7-10f3f8fc6ee7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:55.257577 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-70668f12-ad0d-4756-82c7-10f3f8fc6ee7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:55.263023 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-01435956-e1ba-4505-b18a-448bde49ce81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:55.265803 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-01435956-e1ba-4505-b18a-448bde49ce81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:55.269540 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-01435956-e1ba-4505-b18a-448bde49ce81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:55.273214 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-01435956-e1ba-4505-b18a-448bde49ce81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:55.274412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-01435956-e1ba-4505-b18a-448bde49ce81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:55.275609 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-01435956-e1ba-4505-b18a-448bde49ce81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:55.662091 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-70668f12-ad0d-4756-82c7-10f3f8fc6ee7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:55.676453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-70668f12-ad0d-4756-82c7-10f3f8fc6ee7 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1706 microversion: 2.1 time: 0.450768 Aug 24 09:00:55.704803 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 311/613] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:55 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1706 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:55.727385 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c528ed31-ecb2-4284-8506-f441886137cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:55.732344 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c528ed31-ecb2-4284-8506-f441886137cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:55.732917 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-01435956-e1ba-4505-b18a-448bde49ce81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:55.747075 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-01435956-e1ba-4505-b18a-448bde49ce81 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.531663 Aug 24 09:00:55.760300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 303/614] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:55 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:55.765164 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c528ed31-ecb2-4284-8506-f441886137cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:55.765164 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c528ed31-ecb2-4284-8506-f441886137cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:55.765164 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c528ed31-ecb2-4284-8506-f441886137cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:55.765164 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c528ed31-ecb2-4284-8506-f441886137cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:55.765643 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c528ed31-ecb2-4284-8506-f441886137cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:55.765643 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c528ed31-ecb2-4284-8506-f441886137cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:55.765806 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-61c06a55-b15d-4481-9508-a1bc05e1e027 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:55.765806 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-61c06a55-b15d-4481-9508-a1bc05e1e027 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:55.778318 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-61c06a55-b15d-4481-9508-a1bc05e1e027 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:55.778937 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-61c06a55-b15d-4481-9508-a1bc05e1e027 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:55.779393 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-61c06a55-b15d-4481-9508-a1bc05e1e027 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:55.780412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-61c06a55-b15d-4481-9508-a1bc05e1e027 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:55.788978 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-61c06a55-b15d-4481-9508-a1bc05e1e027 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:55.789834 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-61c06a55-b15d-4481-9508-a1bc05e1e027 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:55.792909 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:56.067531 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c528ed31-ecb2-4284-8506-f441886137cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:56.080571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c528ed31-ecb2-4284-8506-f441886137cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:56.082998 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c528ed31-ecb2-4284-8506-f441886137cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:56.084462 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c528ed31-ecb2-4284-8506-f441886137cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.378549 Aug 24 09:00:56.085289 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 312/615] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:55 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:56.611172 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-61c06a55-b15d-4481-9508-a1bc05e1e027 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:56.632202 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-61c06a55-b15d-4481-9508-a1bc05e1e027 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 0.879815 Aug 24 09:00:56.633371 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 304/616] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:55 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:56.749064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-cbeae0b1-c6bb-4470-b488-2e5ce6acc677 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:56.750946 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-cbeae0b1-c6bb-4470-b488-2e5ce6acc677 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:56.788949 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0c32803e-9739-4717-b11a-bbca35f14991 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:56.792373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cbeae0b1-c6bb-4470-b488-2e5ce6acc677 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:56.793263 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cbeae0b1-c6bb-4470-b488-2e5ce6acc677 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:56.794031 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cbeae0b1-c6bb-4470-b488-2e5ce6acc677 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:56.795482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cbeae0b1-c6bb-4470-b488-2e5ce6acc677 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:56.796317 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cbeae0b1-c6bb-4470-b488-2e5ce6acc677 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:56.797136 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cbeae0b1-c6bb-4470-b488-2e5ce6acc677 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:56.802437 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0c32803e-9739-4717-b11a-bbca35f14991 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:56.816904 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0c32803e-9739-4717-b11a-bbca35f14991 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:56.817786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0c32803e-9739-4717-b11a-bbca35f14991 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:56.818673 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0c32803e-9739-4717-b11a-bbca35f14991 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:56.825749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0c32803e-9739-4717-b11a-bbca35f14991 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:56.826667 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0c32803e-9739-4717-b11a-bbca35f14991 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:56.827548 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0c32803e-9739-4717-b11a-bbca35f14991 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:57.055310 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-cbeae0b1-c6bb-4470-b488-2e5ce6acc677 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:57.070990 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-cbeae0b1-c6bb-4470-b488-2e5ce6acc677 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1706 microversion: 2.1 time: 0.362461 Aug 24 09:00:57.073174 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 313/617] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:56 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1706 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:57.118710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-16e56926-8852-4f04-8a47-6d6245a38ca5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:57.120298 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-16e56926-8852-4f04-8a47-6d6245a38ca5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:57.131584 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16e56926-8852-4f04-8a47-6d6245a38ca5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:57.132404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16e56926-8852-4f04-8a47-6d6245a38ca5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:57.133714 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16e56926-8852-4f04-8a47-6d6245a38ca5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:57.134687 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16e56926-8852-4f04-8a47-6d6245a38ca5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:57.135457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16e56926-8852-4f04-8a47-6d6245a38ca5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:57.136706 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16e56926-8852-4f04-8a47-6d6245a38ca5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:57.328662 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0c32803e-9739-4717-b11a-bbca35f14991 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:57.338512 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0c32803e-9739-4717-b11a-bbca35f14991 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.574376 Aug 24 09:00:57.339097 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 305/618] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:56 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:57.367840 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-16e56926-8852-4f04-8a47-6d6245a38ca5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:57.379917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-16e56926-8852-4f04-8a47-6d6245a38ca5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:57.386934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-16e56926-8852-4f04-8a47-6d6245a38ca5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:57.388340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-16e56926-8852-4f04-8a47-6d6245a38ca5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.282746 Aug 24 09:00:57.394545 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 314/619] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:57 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:57.670495 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-004fcbd7-090d-431f-9d41-237ef8362ba5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:57.675283 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-004fcbd7-090d-431f-9d41-237ef8362ba5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:57.707380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-004fcbd7-090d-431f-9d41-237ef8362ba5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:57.708721 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-004fcbd7-090d-431f-9d41-237ef8362ba5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:57.709886 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-004fcbd7-090d-431f-9d41-237ef8362ba5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:57.713238 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-004fcbd7-090d-431f-9d41-237ef8362ba5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:57.715320 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-004fcbd7-090d-431f-9d41-237ef8362ba5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:57.718077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-004fcbd7-090d-431f-9d41-237ef8362ba5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:58.095401 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-cb11f3e4-c82d-4058-8cbd-052087d0ac6d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:58.096699 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-cb11f3e4-c82d-4058-8cbd-052087d0ac6d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:58.103909 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cb11f3e4-c82d-4058-8cbd-052087d0ac6d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:58.104735 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cb11f3e4-c82d-4058-8cbd-052087d0ac6d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:58.110975 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cb11f3e4-c82d-4058-8cbd-052087d0ac6d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:58.110975 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cb11f3e4-c82d-4058-8cbd-052087d0ac6d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:58.110975 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cb11f3e4-c82d-4058-8cbd-052087d0ac6d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:58.110975 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cb11f3e4-c82d-4058-8cbd-052087d0ac6d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:58.327566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-cb11f3e4-c82d-4058-8cbd-052087d0ac6d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:58.349911 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-004fcbd7-090d-431f-9d41-237ef8362ba5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:58.356405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-cb11f3e4-c82d-4058-8cbd-052087d0ac6d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1706 microversion: 2.1 time: 0.265602 Aug 24 09:00:58.359912 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 315/620] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:58 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1706 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:58.369208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3e7937da-cd3e-4a10-a33d-3648788b7560 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:58.371666 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3e7937da-cd3e-4a10-a33d-3648788b7560 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:58.382218 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-004fcbd7-090d-431f-9d41-237ef8362ba5 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 0.718535 Aug 24 09:00:58.384849 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 306/621] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:57 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:58.395441 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3e7937da-cd3e-4a10-a33d-3648788b7560 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:58.396622 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3e7937da-cd3e-4a10-a33d-3648788b7560 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:58.397812 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3e7937da-cd3e-4a10-a33d-3648788b7560 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:58.399379 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3e7937da-cd3e-4a10-a33d-3648788b7560 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:58.400447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3e7937da-cd3e-4a10-a33d-3648788b7560 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:58.401684 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3e7937da-cd3e-4a10-a33d-3648788b7560 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:58.428740 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a193c8d8-4e6d-44d6-a710-3ce990b1dca1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:58.434262 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a193c8d8-4e6d-44d6-a710-3ce990b1dca1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:58.461856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a193c8d8-4e6d-44d6-a710-3ce990b1dca1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:58.467512 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a193c8d8-4e6d-44d6-a710-3ce990b1dca1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:58.468126 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a193c8d8-4e6d-44d6-a710-3ce990b1dca1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:58.470155 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a193c8d8-4e6d-44d6-a710-3ce990b1dca1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:58.470643 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a193c8d8-4e6d-44d6-a710-3ce990b1dca1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:58.471083 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a193c8d8-4e6d-44d6-a710-3ce990b1dca1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:58.857419 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3e7937da-cd3e-4a10-a33d-3648788b7560 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:58.867116 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3e7937da-cd3e-4a10-a33d-3648788b7560 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.504090 Aug 24 09:00:58.892316 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 316/622] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:58 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:58.897727 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a193c8d8-4e6d-44d6-a710-3ce990b1dca1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:58.915045 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a193c8d8-4e6d-44d6-a710-3ce990b1dca1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:58.918010 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a193c8d8-4e6d-44d6-a710-3ce990b1dca1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:58.919523 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a193c8d8-4e6d-44d6-a710-3ce990b1dca1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.499604 Aug 24 09:00:58.921605 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 307/623] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:58 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:59.387749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f182959a-312b-41f1-9650-afff2876526a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:59.388353 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f182959a-312b-41f1-9650-afff2876526a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:59.397959 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f182959a-312b-41f1-9650-afff2876526a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:59.398917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f182959a-312b-41f1-9650-afff2876526a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:59.400096 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f182959a-312b-41f1-9650-afff2876526a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:59.401537 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f182959a-312b-41f1-9650-afff2876526a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:59.405310 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f182959a-312b-41f1-9650-afff2876526a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:59.406200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f182959a-312b-41f1-9650-afff2876526a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:59.412585 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-861ebe46-5ad6-4b2e-802e-3f8d53e9102a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:59.413437 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-861ebe46-5ad6-4b2e-802e-3f8d53e9102a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:59.421608 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-861ebe46-5ad6-4b2e-802e-3f8d53e9102a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:59.424228 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-861ebe46-5ad6-4b2e-802e-3f8d53e9102a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:59.424228 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-861ebe46-5ad6-4b2e-802e-3f8d53e9102a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:59.424228 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-861ebe46-5ad6-4b2e-802e-3f8d53e9102a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:59.424910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-861ebe46-5ad6-4b2e-802e-3f8d53e9102a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:59.425576 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-861ebe46-5ad6-4b2e-802e-3f8d53e9102a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:59.643765 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f182959a-312b-41f1-9650-afff2876526a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:59.666926 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f182959a-312b-41f1-9650-afff2876526a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1706 microversion: 2.1 time: 0.284483 Aug 24 09:00:59.692097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 317/624] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:59 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1706 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:59.872436 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-861ebe46-5ad6-4b2e-802e-3f8d53e9102a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:59.894057 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-861ebe46-5ad6-4b2e-802e-3f8d53e9102a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 0.487344 Aug 24 09:00:59.897529 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-bba97d8a-751c-4d55-800f-098178f8c141 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:59.899894 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-bba97d8a-751c-4d55-800f-098178f8c141 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:59.900317 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 308/625] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:59 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:59.923074 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bba97d8a-751c-4d55-800f-098178f8c141 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:59.923921 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bba97d8a-751c-4d55-800f-098178f8c141 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:59.928097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bba97d8a-751c-4d55-800f-098178f8c141 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:59.928097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bba97d8a-751c-4d55-800f-098178f8c141 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:59.928097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bba97d8a-751c-4d55-800f-098178f8c141 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:59.928097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bba97d8a-751c-4d55-800f-098178f8c141 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:59.946370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b27c5609-3511-4596-9796-39cc64c59d4f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:59.948778 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b27c5609-3511-4596-9796-39cc64c59d4f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:59.957885 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b27c5609-3511-4596-9796-39cc64c59d4f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:59.965324 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b27c5609-3511-4596-9796-39cc64c59d4f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:59.966322 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b27c5609-3511-4596-9796-39cc64c59d4f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:59.967257 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b27c5609-3511-4596-9796-39cc64c59d4f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:59.968077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b27c5609-3511-4596-9796-39cc64c59d4f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:59.968796 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b27c5609-3511-4596-9796-39cc64c59d4f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:00.147489 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-bba97d8a-751c-4d55-800f-098178f8c141 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:00.157502 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-bba97d8a-751c-4d55-800f-098178f8c141 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.267825 Aug 24 09:01:00.158404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 318/626] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:59 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:00.306377 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b27c5609-3511-4596-9796-39cc64c59d4f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:00.316251 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b27c5609-3511-4596-9796-39cc64c59d4f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:00.325820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b27c5609-3511-4596-9796-39cc64c59d4f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:00.327211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b27c5609-3511-4596-9796-39cc64c59d4f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.386704 Aug 24 09:01:00.327967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 309/627] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:59 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:00.696990 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3692f7b7-8b02-463f-8e5a-37905e7d8908 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:00.698452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3692f7b7-8b02-463f-8e5a-37905e7d8908 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:00.717084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3692f7b7-8b02-463f-8e5a-37905e7d8908 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:00.718248 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3692f7b7-8b02-463f-8e5a-37905e7d8908 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:00.718972 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3692f7b7-8b02-463f-8e5a-37905e7d8908 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:00.719987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3692f7b7-8b02-463f-8e5a-37905e7d8908 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:00.720817 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3692f7b7-8b02-463f-8e5a-37905e7d8908 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:00.721578 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3692f7b7-8b02-463f-8e5a-37905e7d8908 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:00.920239 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c21e0685-a495-46ec-8482-fb3bd14de41e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:00.926948 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c21e0685-a495-46ec-8482-fb3bd14de41e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:00.928123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c21e0685-a495-46ec-8482-fb3bd14de41e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:00.928909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c21e0685-a495-46ec-8482-fb3bd14de41e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:00.929546 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c21e0685-a495-46ec-8482-fb3bd14de41e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:00.930540 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c21e0685-a495-46ec-8482-fb3bd14de41e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:00.931170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c21e0685-a495-46ec-8482-fb3bd14de41e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:00.931761 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c21e0685-a495-46ec-8482-fb3bd14de41e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:00.945581 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3692f7b7-8b02-463f-8e5a-37905e7d8908 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:00.954552 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3692f7b7-8b02-463f-8e5a-37905e7d8908 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1706 microversion: 2.1 time: 0.262426 Aug 24 09:01:00.968567 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 319/628] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:00 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1706 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:01.133673 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c21e0685-a495-46ec-8482-fb3bd14de41e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:01.146006 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c21e0685-a495-46ec-8482-fb3bd14de41e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 0.232102 Aug 24 09:01:01.146818 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 310/629] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:00 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:01.179352 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a0d91ac7-360c-49dc-83fb-b8ada04c126c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:01.180183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a0d91ac7-360c-49dc-83fb-b8ada04c126c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:01.187277 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0d91ac7-360c-49dc-83fb-b8ada04c126c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:01.187768 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0d91ac7-360c-49dc-83fb-b8ada04c126c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:01.188184 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0d91ac7-360c-49dc-83fb-b8ada04c126c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:01.189165 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0d91ac7-360c-49dc-83fb-b8ada04c126c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:01.189606 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0d91ac7-360c-49dc-83fb-b8ada04c126c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:01.190214 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0d91ac7-360c-49dc-83fb-b8ada04c126c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:01.351795 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f41788f3-f195-4636-922e-ad365519bdf4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:01.352657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f41788f3-f195-4636-922e-ad365519bdf4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:01.359826 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f41788f3-f195-4636-922e-ad365519bdf4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:01.360518 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f41788f3-f195-4636-922e-ad365519bdf4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:01.361128 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f41788f3-f195-4636-922e-ad365519bdf4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:01.362014 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f41788f3-f195-4636-922e-ad365519bdf4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:01.362620 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f41788f3-f195-4636-922e-ad365519bdf4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:01.363193 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f41788f3-f195-4636-922e-ad365519bdf4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:01.419217 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a0d91ac7-360c-49dc-83fb-b8ada04c126c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:01.450535 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a0d91ac7-360c-49dc-83fb-b8ada04c126c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.265481 Aug 24 09:01:01.457261 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 320/630] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:01 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:01.548673 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f41788f3-f195-4636-922e-ad365519bdf4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:01.565301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f41788f3-f195-4636-922e-ad365519bdf4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:01.568493 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f41788f3-f195-4636-922e-ad365519bdf4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:01.570775 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f41788f3-f195-4636-922e-ad365519bdf4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.222959 Aug 24 09:01:01.572203 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 311/631] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:01 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:01.979784 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7dfabc1b-7d46-465d-8427-a62befd1a6aa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:01.980783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7dfabc1b-7d46-465d-8427-a62befd1a6aa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:02.021168 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7dfabc1b-7d46-465d-8427-a62befd1a6aa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:02.026343 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7dfabc1b-7d46-465d-8427-a62befd1a6aa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:02.031394 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7dfabc1b-7d46-465d-8427-a62befd1a6aa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:02.033778 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7dfabc1b-7d46-465d-8427-a62befd1a6aa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:02.036084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7dfabc1b-7d46-465d-8427-a62befd1a6aa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:02.039267 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7dfabc1b-7d46-465d-8427-a62befd1a6aa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:02.174719 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fae60d4c-4561-4e67-8aff-fe8f0c84a475 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:02.183121 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-fae60d4c-4561-4e67-8aff-fe8f0c84a475 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:02.238029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fae60d4c-4561-4e67-8aff-fe8f0c84a475 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:02.239364 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fae60d4c-4561-4e67-8aff-fe8f0c84a475 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:02.240327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fae60d4c-4561-4e67-8aff-fe8f0c84a475 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:02.244507 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fae60d4c-4561-4e67-8aff-fe8f0c84a475 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:02.249594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fae60d4c-4561-4e67-8aff-fe8f0c84a475 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:02.251098 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fae60d4c-4561-4e67-8aff-fe8f0c84a475 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:02.459152 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7dfabc1b-7d46-465d-8427-a62befd1a6aa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:02.473881 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7dfabc1b-7d46-465d-8427-a62befd1a6aa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1710 microversion: 2.1 time: 0.498775 Aug 24 09:01:02.481255 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 321/632] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:01 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1710 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:02.503721 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1b014497-1fd0-4667-a894-b6fd6ee32879 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:02.508055 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1b014497-1fd0-4667-a894-b6fd6ee32879 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:02.540226 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1b014497-1fd0-4667-a894-b6fd6ee32879 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:02.544530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1b014497-1fd0-4667-a894-b6fd6ee32879 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:02.545909 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1b014497-1fd0-4667-a894-b6fd6ee32879 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:02.550055 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1b014497-1fd0-4667-a894-b6fd6ee32879 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:02.553229 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1b014497-1fd0-4667-a894-b6fd6ee32879 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:02.554577 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1b014497-1fd0-4667-a894-b6fd6ee32879 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:02.653015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fae60d4c-4561-4e67-8aff-fe8f0c84a475 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:02.670388 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fae60d4c-4561-4e67-8aff-fe8f0c84a475 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 0.506335 Aug 24 09:01:02.685485 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 312/633] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:02 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:02.691369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9e4107ea-fd2a-4a02-879b-e693b1738fb8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:02.692223 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9e4107ea-fd2a-4a02-879b-e693b1738fb8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:02.699040 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e4107ea-fd2a-4a02-879b-e693b1738fb8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:02.699553 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e4107ea-fd2a-4a02-879b-e693b1738fb8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:02.699984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e4107ea-fd2a-4a02-879b-e693b1738fb8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:02.700794 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e4107ea-fd2a-4a02-879b-e693b1738fb8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:02.701246 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e4107ea-fd2a-4a02-879b-e693b1738fb8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:02.701667 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9e4107ea-fd2a-4a02-879b-e693b1738fb8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:02.795833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1b014497-1fd0-4667-a894-b6fd6ee32879 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:02.808175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1b014497-1fd0-4667-a894-b6fd6ee32879 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.323735 Aug 24 09:01:02.812593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 322/634] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:02 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:03.053731 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9e4107ea-fd2a-4a02-879b-e693b1738fb8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:03.063971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9e4107ea-fd2a-4a02-879b-e693b1738fb8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:03.066501 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9e4107ea-fd2a-4a02-879b-e693b1738fb8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:03.073592 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9e4107ea-fd2a-4a02-879b-e693b1738fb8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.380850 Aug 24 09:01:03.084515 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 313/635] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:02 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:03.691797 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0381adf6-944e-4907-924c-01c3a43a0202 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:03.692781 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0381adf6-944e-4907-924c-01c3a43a0202 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:03.702683 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0381adf6-944e-4907-924c-01c3a43a0202 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:03.703544 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0381adf6-944e-4907-924c-01c3a43a0202 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:03.704058 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0381adf6-944e-4907-924c-01c3a43a0202 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:03.704977 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0381adf6-944e-4907-924c-01c3a43a0202 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:03.705524 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0381adf6-944e-4907-924c-01c3a43a0202 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:03.706050 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0381adf6-944e-4907-924c-01c3a43a0202 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:03.832069 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-65594c99-13ac-49fb-b9b3-5d1dab09a321 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:03.833444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-65594c99-13ac-49fb-b9b3-5d1dab09a321 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:03.849775 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-65594c99-13ac-49fb-b9b3-5d1dab09a321 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:03.852635 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-65594c99-13ac-49fb-b9b3-5d1dab09a321 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:03.856246 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-65594c99-13ac-49fb-b9b3-5d1dab09a321 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:03.857922 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-65594c99-13ac-49fb-b9b3-5d1dab09a321 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:03.858666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-65594c99-13ac-49fb-b9b3-5d1dab09a321 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:03.861677 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-65594c99-13ac-49fb-b9b3-5d1dab09a321 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:04.202001 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-65594c99-13ac-49fb-b9b3-5d1dab09a321 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:04.215123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-65594c99-13ac-49fb-b9b3-5d1dab09a321 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.387860 Aug 24 09:01:04.216321 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 314/636] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:03 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:04.222899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-878ffa08-caa3-413c-b066-9dcd8a9a0c63 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:04.222899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-878ffa08-caa3-413c-b066-9dcd8a9a0c63 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:04.231222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-878ffa08-caa3-413c-b066-9dcd8a9a0c63 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:04.232130 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-878ffa08-caa3-413c-b066-9dcd8a9a0c63 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:04.232830 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-878ffa08-caa3-413c-b066-9dcd8a9a0c63 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:04.233815 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-878ffa08-caa3-413c-b066-9dcd8a9a0c63 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:04.234514 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-878ffa08-caa3-413c-b066-9dcd8a9a0c63 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:04.235232 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-878ffa08-caa3-413c-b066-9dcd8a9a0c63 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:04.238634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:04.459426 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-878ffa08-caa3-413c-b066-9dcd8a9a0c63 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:04.472232 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-878ffa08-caa3-413c-b066-9dcd8a9a0c63 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:04.474476 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-878ffa08-caa3-413c-b066-9dcd8a9a0c63 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:04.475717 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-878ffa08-caa3-413c-b066-9dcd8a9a0c63 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1739 microversion: 2.20 time: 0.258021 Aug 24 09:01:04.482054 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 315/637] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:04 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:04.487190 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-d61cf8ad-456a-468c-a5cc-65c6f36661b0 req-ddb089ca-f874-4106-939b-fcc3282dfae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20347088-35b8-4cfe-8457-8ca131fcfa2c", "name": "network-vif-plugged", "status": "completed", "tag": "df5ed933-769b-4275-a845-9beb266eb36d"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:04.508445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-d61cf8ad-456a-468c-a5cc-65c6f36661b0 req-ddb089ca-f874-4106-939b-fcc3282dfae9 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:04.509326 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-d61cf8ad-456a-468c-a5cc-65c6f36661b0 req-ddb089ca-f874-4106-939b-fcc3282dfae9 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:04.510540 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-d61cf8ad-456a-468c-a5cc-65c6f36661b0 req-ddb089ca-f874-4106-939b-fcc3282dfae9 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:04.539305 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-d61cf8ad-456a-468c-a5cc-65c6f36661b0 req-ddb089ca-f874-4106-939b-fcc3282dfae9 service nova] Creating event network-vif-plugged:df5ed933-769b-4275-a845-9beb266eb36d for instance 20347088-35b8-4cfe-8457-8ca131fcfa2c on hv-cinder-85221 Aug 24 09:01:04.548160 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-d61cf8ad-456a-468c-a5cc-65c6f36661b0 req-ddb089ca-f874-4106-939b-fcc3282dfae9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064462 Aug 24 09:01:04.562482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 316/638] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:01:04.828842 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0381adf6-944e-4907-924c-01c3a43a0202 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:04.856202 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0381adf6-944e-4907-924c-01c3a43a0202 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 1.168545 Aug 24 09:01:04.861322 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 323/639] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:03 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:05.243182 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1fd5f375-ac10-4c6c-b7db-76a916486392 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:05.243907 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1fd5f375-ac10-4c6c-b7db-76a916486392 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:05.251433 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1fd5f375-ac10-4c6c-b7db-76a916486392 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:05.251931 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1fd5f375-ac10-4c6c-b7db-76a916486392 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:05.252566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1fd5f375-ac10-4c6c-b7db-76a916486392 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:05.253487 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1fd5f375-ac10-4c6c-b7db-76a916486392 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:05.253956 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1fd5f375-ac10-4c6c-b7db-76a916486392 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:05.254383 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1fd5f375-ac10-4c6c-b7db-76a916486392 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:05.519108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-166ef8a7-9edf-4d7a-a78e-b8f762935a75 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:05.520418 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-166ef8a7-9edf-4d7a-a78e-b8f762935a75 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:05.537908 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-166ef8a7-9edf-4d7a-a78e-b8f762935a75 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:05.537908 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-166ef8a7-9edf-4d7a-a78e-b8f762935a75 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:05.537908 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-166ef8a7-9edf-4d7a-a78e-b8f762935a75 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:05.537908 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-166ef8a7-9edf-4d7a-a78e-b8f762935a75 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:05.538333 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-166ef8a7-9edf-4d7a-a78e-b8f762935a75 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:05.538529 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-166ef8a7-9edf-4d7a-a78e-b8f762935a75 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:05.796240 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1fd5f375-ac10-4c6c-b7db-76a916486392 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:05.809210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1fd5f375-ac10-4c6c-b7db-76a916486392 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.573588 Aug 24 09:01:05.809874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 317/640] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:05 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:05.835906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-166ef8a7-9edf-4d7a-a78e-b8f762935a75 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:05.852567 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-166ef8a7-9edf-4d7a-a78e-b8f762935a75 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:05.859947 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-166ef8a7-9edf-4d7a-a78e-b8f762935a75 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:05.863052 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-166ef8a7-9edf-4d7a-a78e-b8f762935a75 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1721 microversion: 2.20 time: 0.356738 Aug 24 09:01:05.864525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 324/641] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:05 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1721 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:05.890117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f9c48111-2ca2-46c3-95fb-47481a67095a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:05.890977 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f9c48111-2ca2-46c3-95fb-47481a67095a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:05.899807 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f9c48111-2ca2-46c3-95fb-47481a67095a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:05.901159 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f9c48111-2ca2-46c3-95fb-47481a67095a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:05.901844 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f9c48111-2ca2-46c3-95fb-47481a67095a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:05.902892 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f9c48111-2ca2-46c3-95fb-47481a67095a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:05.903822 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f9c48111-2ca2-46c3-95fb-47481a67095a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:05.904467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f9c48111-2ca2-46c3-95fb-47481a67095a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:06.121199 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f9c48111-2ca2-46c3-95fb-47481a67095a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:06.133331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f9c48111-2ca2-46c3-95fb-47481a67095a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 0.252178 Aug 24 09:01:06.148287 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 318/642] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:05 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:06.591399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-7ffd85bd-cb88-4b64-a6ce-5c348567b2ac req-3154a03b-cc55-4f28-b073-7248fb9338d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "713b8af9-0654-40a5-bae9-0592267a0458", "name": "network-vif-plugged", "status": "completed", "tag": "a8514a53-9b36-48eb-9c4f-354a332273c4"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:06.627298 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-7ffd85bd-cb88-4b64-a6ce-5c348567b2ac req-3154a03b-cc55-4f28-b073-7248fb9338d6 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:06.628158 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-7ffd85bd-cb88-4b64-a6ce-5c348567b2ac req-3154a03b-cc55-4f28-b073-7248fb9338d6 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:06.628961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-7ffd85bd-cb88-4b64-a6ce-5c348567b2ac req-3154a03b-cc55-4f28-b073-7248fb9338d6 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:06.667251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-7ffd85bd-cb88-4b64-a6ce-5c348567b2ac req-3154a03b-cc55-4f28-b073-7248fb9338d6 service nova] Creating event network-vif-plugged:a8514a53-9b36-48eb-9c4f-354a332273c4 for instance 713b8af9-0654-40a5-bae9-0592267a0458 on hv-cinder-85221 Aug 24 09:01:06.701130 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-7ffd85bd-cb88-4b64-a6ce-5c348567b2ac req-3154a03b-cc55-4f28-b073-7248fb9338d6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116513 Aug 24 09:01:06.702487 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 325/643] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:01:06.851366 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1acb5869-46f3-44e0-afa9-bc93ae82e6c3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:06.852463 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1acb5869-46f3-44e0-afa9-bc93ae82e6c3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:06.890428 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1acb5869-46f3-44e0-afa9-bc93ae82e6c3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:06.894913 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1acb5869-46f3-44e0-afa9-bc93ae82e6c3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:06.897198 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1acb5869-46f3-44e0-afa9-bc93ae82e6c3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:06.901205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1acb5869-46f3-44e0-afa9-bc93ae82e6c3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:06.905215 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1acb5869-46f3-44e0-afa9-bc93ae82e6c3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:06.906421 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1acb5869-46f3-44e0-afa9-bc93ae82e6c3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:06.910124 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-32ad6925-aaa5-401d-b584-19d04cf25a52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:06.910845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-32ad6925-aaa5-401d-b584-19d04cf25a52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:06.953454 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-32ad6925-aaa5-401d-b584-19d04cf25a52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:06.958181 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-32ad6925-aaa5-401d-b584-19d04cf25a52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:06.959343 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-32ad6925-aaa5-401d-b584-19d04cf25a52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:06.962541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-32ad6925-aaa5-401d-b584-19d04cf25a52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:06.966138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-32ad6925-aaa5-401d-b584-19d04cf25a52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:06.966907 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-32ad6925-aaa5-401d-b584-19d04cf25a52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:07.211973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1acb5869-46f3-44e0-afa9-bc93ae82e6c3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:07.226455 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1acb5869-46f3-44e0-afa9-bc93ae82e6c3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.383950 Aug 24 09:01:07.229660 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 319/644] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:06 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:07.234795 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1e7aa81a-1aa1-4a71-9491-fa2cb6400686 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:07.235724 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1e7aa81a-1aa1-4a71-9491-fa2cb6400686 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:07.244201 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1e7aa81a-1aa1-4a71-9491-fa2cb6400686 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:07.244795 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1e7aa81a-1aa1-4a71-9491-fa2cb6400686 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:07.245241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1e7aa81a-1aa1-4a71-9491-fa2cb6400686 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:07.246061 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1e7aa81a-1aa1-4a71-9491-fa2cb6400686 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:07.254298 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1e7aa81a-1aa1-4a71-9491-fa2cb6400686 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:07.254298 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1e7aa81a-1aa1-4a71-9491-fa2cb6400686 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:07.284760 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-32ad6925-aaa5-401d-b584-19d04cf25a52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:07.303962 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-32ad6925-aaa5-401d-b584-19d04cf25a52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:07.307729 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-32ad6925-aaa5-401d-b584-19d04cf25a52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:07.310221 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-32ad6925-aaa5-401d-b584-19d04cf25a52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1721 microversion: 2.20 time: 0.416302 Aug 24 09:01:07.311544 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 326/645] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:06 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1721 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:07.412777 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1e7aa81a-1aa1-4a71-9491-fa2cb6400686 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:07.422711 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1e7aa81a-1aa1-4a71-9491-fa2cb6400686 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1265 microversion: 2.1 time: 0.191586 Aug 24 09:01:07.433034 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 320/646] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:07 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:08.267063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-23b76b91-df24-4dc6-a809-98ad1b1a5afe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:08.284655 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-23b76b91-df24-4dc6-a809-98ad1b1a5afe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:08.298087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-23b76b91-df24-4dc6-a809-98ad1b1a5afe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:08.298579 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-23b76b91-df24-4dc6-a809-98ad1b1a5afe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:08.299188 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-23b76b91-df24-4dc6-a809-98ad1b1a5afe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:08.300087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-23b76b91-df24-4dc6-a809-98ad1b1a5afe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:08.302915 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-23b76b91-df24-4dc6-a809-98ad1b1a5afe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:08.310926 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-23b76b91-df24-4dc6-a809-98ad1b1a5afe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:08.337711 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6882f1f6-d13a-4603-b87d-d081dd8e7b48 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:08.339917 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6882f1f6-d13a-4603-b87d-d081dd8e7b48 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:08.346796 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6882f1f6-d13a-4603-b87d-d081dd8e7b48 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:08.347380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6882f1f6-d13a-4603-b87d-d081dd8e7b48 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:08.348021 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6882f1f6-d13a-4603-b87d-d081dd8e7b48 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:08.348963 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6882f1f6-d13a-4603-b87d-d081dd8e7b48 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:08.349699 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6882f1f6-d13a-4603-b87d-d081dd8e7b48 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:08.351047 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6882f1f6-d13a-4603-b87d-d081dd8e7b48 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:08.518409 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-23b76b91-df24-4dc6-a809-98ad1b1a5afe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:08.541552 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-23b76b91-df24-4dc6-a809-98ad1b1a5afe tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.294330 Aug 24 09:01:08.556568 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 327/647] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:08 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:08.556568 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d3873eb8-9ec3-44e1-b174-5090c46fe245 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:08.556568 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d3873eb8-9ec3-44e1-b174-5090c46fe245 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:08.572879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d3873eb8-9ec3-44e1-b174-5090c46fe245 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:08.573555 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d3873eb8-9ec3-44e1-b174-5090c46fe245 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:08.574115 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d3873eb8-9ec3-44e1-b174-5090c46fe245 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:08.574963 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d3873eb8-9ec3-44e1-b174-5090c46fe245 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:08.575535 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d3873eb8-9ec3-44e1-b174-5090c46fe245 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:08.578646 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d3873eb8-9ec3-44e1-b174-5090c46fe245 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:08.627739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6882f1f6-d13a-4603-b87d-d081dd8e7b48 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:08.638581 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6882f1f6-d13a-4603-b87d-d081dd8e7b48 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:08.643446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6882f1f6-d13a-4603-b87d-d081dd8e7b48 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:08.649521 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6882f1f6-d13a-4603-b87d-d081dd8e7b48 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1721 microversion: 2.20 time: 0.316540 Aug 24 09:01:08.650967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 321/648] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:08 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1721 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:08.726143 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-bc6de51d-a1e5-4c3e-97ad-dc71a80b0252 req-9cbefbda-8b3f-43ad-a96d-d83c114dc7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abdb5828-315b-4046-9985-95e58a2f24b3", "name": "network-vif-unplugged", "status": "completed", "tag": "756cdfb7-826d-4039-9977-c15d62078dd5"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:08.738745 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-bc6de51d-a1e5-4c3e-97ad-dc71a80b0252 req-9cbefbda-8b3f-43ad-a96d-d83c114dc7fb service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:08.739236 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-bc6de51d-a1e5-4c3e-97ad-dc71a80b0252 req-9cbefbda-8b3f-43ad-a96d-d83c114dc7fb service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:08.739669 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-bc6de51d-a1e5-4c3e-97ad-dc71a80b0252 req-9cbefbda-8b3f-43ad-a96d-d83c114dc7fb service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:08.771246 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-bc6de51d-a1e5-4c3e-97ad-dc71a80b0252 req-9cbefbda-8b3f-43ad-a96d-d83c114dc7fb service nova] Creating event network-vif-unplugged:756cdfb7-826d-4039-9977-c15d62078dd5 for instance abdb5828-315b-4046-9985-95e58a2f24b3 on hv-cinder-85221 Aug 24 09:01:08.798083 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-bc6de51d-a1e5-4c3e-97ad-dc71a80b0252 req-9cbefbda-8b3f-43ad-a96d-d83c114dc7fb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074248 Aug 24 09:01:08.799761 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 322/649] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:01:08.928519 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d3873eb8-9ec3-44e1-b174-5090c46fe245 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:08.952803 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d3873eb8-9ec3-44e1-b174-5090c46fe245 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1452 microversion: 2.1 time: 0.405796 Aug 24 09:01:08.954055 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 328/650] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:08 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1452 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:09.008222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d14ddb77-f82b-432f-b6e2-bc73fd691c74 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:09.009334 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d14ddb77-f82b-432f-b6e2-bc73fd691c74 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:09.026012 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d14ddb77-f82b-432f-b6e2-bc73fd691c74 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:09.027281 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d14ddb77-f82b-432f-b6e2-bc73fd691c74 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:09.027869 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d14ddb77-f82b-432f-b6e2-bc73fd691c74 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:09.028762 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d14ddb77-f82b-432f-b6e2-bc73fd691c74 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:09.030942 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d14ddb77-f82b-432f-b6e2-bc73fd691c74 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:09.031455 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d14ddb77-f82b-432f-b6e2-bc73fd691c74 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:09.223183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d14ddb77-f82b-432f-b6e2-bc73fd691c74 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:09.232987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d14ddb77-f82b-432f-b6e2-bc73fd691c74 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1452 microversion: 2.1 time: 0.232099 Aug 24 09:01:09.234297 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 323/651] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:08 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1452 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:09.574600 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-27f2b12d-7fa6-4f9e-b20f-55d86a6696dd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:09.576979 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-27f2b12d-7fa6-4f9e-b20f-55d86a6696dd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:09.593040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27f2b12d-7fa6-4f9e-b20f-55d86a6696dd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:09.594425 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27f2b12d-7fa6-4f9e-b20f-55d86a6696dd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:09.597873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27f2b12d-7fa6-4f9e-b20f-55d86a6696dd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:09.599603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27f2b12d-7fa6-4f9e-b20f-55d86a6696dd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:09.600696 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27f2b12d-7fa6-4f9e-b20f-55d86a6696dd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:09.601708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27f2b12d-7fa6-4f9e-b20f-55d86a6696dd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:09.677210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b74b9378-7aa1-442a-9d36-3ed4f86c363a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:09.678495 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b74b9378-7aa1-442a-9d36-3ed4f86c363a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:09.688730 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b74b9378-7aa1-442a-9d36-3ed4f86c363a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:09.690907 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b74b9378-7aa1-442a-9d36-3ed4f86c363a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:09.691741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b74b9378-7aa1-442a-9d36-3ed4f86c363a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:09.693308 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b74b9378-7aa1-442a-9d36-3ed4f86c363a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:09.697987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b74b9378-7aa1-442a-9d36-3ed4f86c363a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:09.698723 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b74b9378-7aa1-442a-9d36-3ed4f86c363a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:09.905689 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b74b9378-7aa1-442a-9d36-3ed4f86c363a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:09.922625 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b74b9378-7aa1-442a-9d36-3ed4f86c363a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:09.929309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b74b9378-7aa1-442a-9d36-3ed4f86c363a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:09.933064 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b74b9378-7aa1-442a-9d36-3ed4f86c363a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1721 microversion: 2.20 time: 0.259336 Aug 24 09:01:09.934550 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 324/652] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:09 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1721 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:10.008694 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-27f2b12d-7fa6-4f9e-b20f-55d86a6696dd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:10.018710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:10.021911 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-27f2b12d-7fa6-4f9e-b20f-55d86a6696dd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.455348 Aug 24 09:01:10.029537 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 329/653] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:09 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:10.958131 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-255aba1c-722b-4d72-ac1c-101e7e11dfe7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:10.958680 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-255aba1c-722b-4d72-ac1c-101e7e11dfe7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:10.966342 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-255aba1c-722b-4d72-ac1c-101e7e11dfe7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:10.966837 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-255aba1c-722b-4d72-ac1c-101e7e11dfe7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:10.967275 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-255aba1c-722b-4d72-ac1c-101e7e11dfe7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:10.967992 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-255aba1c-722b-4d72-ac1c-101e7e11dfe7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:10.968449 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-255aba1c-722b-4d72-ac1c-101e7e11dfe7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:10.968905 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-255aba1c-722b-4d72-ac1c-101e7e11dfe7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:11.062838 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-12c651fc-d9a5-46a7-a437-dfc3a994aa69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:11.065021 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-12c651fc-d9a5-46a7-a437-dfc3a994aa69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:11.080085 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-12c651fc-d9a5-46a7-a437-dfc3a994aa69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:11.081223 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-12c651fc-d9a5-46a7-a437-dfc3a994aa69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:11.082568 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-12c651fc-d9a5-46a7-a437-dfc3a994aa69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:11.084024 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-12c651fc-d9a5-46a7-a437-dfc3a994aa69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:11.085048 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-12c651fc-d9a5-46a7-a437-dfc3a994aa69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:11.085961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-12c651fc-d9a5-46a7-a437-dfc3a994aa69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:11.207352 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-255aba1c-722b-4d72-ac1c-101e7e11dfe7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:11.218751 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-255aba1c-722b-4d72-ac1c-101e7e11dfe7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:11.220362 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-255aba1c-722b-4d72-ac1c-101e7e11dfe7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:11.221728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-255aba1c-722b-4d72-ac1c-101e7e11dfe7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1721 microversion: 2.20 time: 0.267771 Aug 24 09:01:11.222645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 325/654] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:10 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1721 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:11.448376 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-12c651fc-d9a5-46a7-a437-dfc3a994aa69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:11.457287 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-12c651fc-d9a5-46a7-a437-dfc3a994aa69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.404464 Aug 24 09:01:11.458117 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 330/655] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:11 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:12.253291 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c65129fb-a656-4a66-8440-5578cfc024ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:12.267458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c65129fb-a656-4a66-8440-5578cfc024ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:12.299027 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c65129fb-a656-4a66-8440-5578cfc024ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:12.307759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c65129fb-a656-4a66-8440-5578cfc024ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:12.309115 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c65129fb-a656-4a66-8440-5578cfc024ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:12.315660 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c65129fb-a656-4a66-8440-5578cfc024ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:12.316851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c65129fb-a656-4a66-8440-5578cfc024ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:12.321818 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c65129fb-a656-4a66-8440-5578cfc024ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:12.492937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-98202236-014c-4a1f-af36-c92c05cbba3e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:12.494244 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-98202236-014c-4a1f-af36-c92c05cbba3e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:12.528601 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-98202236-014c-4a1f-af36-c92c05cbba3e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:12.535621 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-98202236-014c-4a1f-af36-c92c05cbba3e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:12.540736 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-98202236-014c-4a1f-af36-c92c05cbba3e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:12.553192 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-98202236-014c-4a1f-af36-c92c05cbba3e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:12.555498 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-98202236-014c-4a1f-af36-c92c05cbba3e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:12.557811 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-98202236-014c-4a1f-af36-c92c05cbba3e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:12.678042 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c65129fb-a656-4a66-8440-5578cfc024ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:12.694502 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c65129fb-a656-4a66-8440-5578cfc024ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:12.698603 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c65129fb-a656-4a66-8440-5578cfc024ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:12.704674 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c65129fb-a656-4a66-8440-5578cfc024ef tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1721 microversion: 2.20 time: 0.460517 Aug 24 09:01:12.725565 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 326/656] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:12 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1721 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:13.085736 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-98202236-014c-4a1f-af36-c92c05cbba3e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:13.097414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-98202236-014c-4a1f-af36-c92c05cbba3e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.620793 Aug 24 09:01:13.111674 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 331/657] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:12 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:13.636472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-178fd738-5a71-4ed3-8588-701112c86358 req-9740f5e0-f7c7-4466-95dd-7571d806408e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20347088-35b8-4cfe-8457-8ca131fcfa2c", "tag": "df5ed933-769b-4275-a845-9beb266eb36d"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:13.648580 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-178fd738-5a71-4ed3-8588-701112c86358 req-9740f5e0-f7c7-4466-95dd-7571d806408e service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:13.649659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-178fd738-5a71-4ed3-8588-701112c86358 req-9740f5e0-f7c7-4466-95dd-7571d806408e service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:13.650147 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-178fd738-5a71-4ed3-8588-701112c86358 req-9740f5e0-f7c7-4466-95dd-7571d806408e service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:13.665275 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-178fd738-5a71-4ed3-8588-701112c86358 req-9740f5e0-f7c7-4466-95dd-7571d806408e service nova] Creating event network-changed:df5ed933-769b-4275-a845-9beb266eb36d for instance 20347088-35b8-4cfe-8457-8ca131fcfa2c on hv-cinder-85221 Aug 24 09:01:13.670768 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-178fd738-5a71-4ed3-8588-701112c86358 req-9740f5e0-f7c7-4466-95dd-7571d806408e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254256 Aug 24 09:01:13.671996 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 327/658] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:01:13.753711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6b64c747-3a6b-424c-96f1-2c041fdec630 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:13.758487 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6b64c747-3a6b-424c-96f1-2c041fdec630 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:13.768350 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6b64c747-3a6b-424c-96f1-2c041fdec630 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:13.769250 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6b64c747-3a6b-424c-96f1-2c041fdec630 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:13.769947 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6b64c747-3a6b-424c-96f1-2c041fdec630 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:13.770950 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6b64c747-3a6b-424c-96f1-2c041fdec630 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:13.774320 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6b64c747-3a6b-424c-96f1-2c041fdec630 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:13.775534 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6b64c747-3a6b-424c-96f1-2c041fdec630 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:13.966465 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6b64c747-3a6b-424c-96f1-2c041fdec630 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:13.975548 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6b64c747-3a6b-424c-96f1-2c041fdec630 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:13.977733 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6b64c747-3a6b-424c-96f1-2c041fdec630 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:13.979807 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6b64c747-3a6b-424c-96f1-2c041fdec630 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1721 microversion: 2.20 time: 0.230361 Aug 24 09:01:13.981166 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 332/659] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:13 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:14.123908 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-36ed45d6-4aae-4522-9072-a4e1693d39b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:14.125822 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-36ed45d6-4aae-4522-9072-a4e1693d39b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:14.139053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36ed45d6-4aae-4522-9072-a4e1693d39b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:14.140238 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36ed45d6-4aae-4522-9072-a4e1693d39b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:14.141301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36ed45d6-4aae-4522-9072-a4e1693d39b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:14.143128 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36ed45d6-4aae-4522-9072-a4e1693d39b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:14.144236 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36ed45d6-4aae-4522-9072-a4e1693d39b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:14.145061 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36ed45d6-4aae-4522-9072-a4e1693d39b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:14.377971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-36ed45d6-4aae-4522-9072-a4e1693d39b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:14.389390 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-36ed45d6-4aae-4522-9072-a4e1693d39b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.272201 Aug 24 09:01:14.390198 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 328/660] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:14 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:15.003954 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c221c0b2-db8b-4e99-aad0-4a50bb425461 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:15.004612 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c221c0b2-db8b-4e99-aad0-4a50bb425461 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:15.012111 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c221c0b2-db8b-4e99-aad0-4a50bb425461 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:15.012654 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c221c0b2-db8b-4e99-aad0-4a50bb425461 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:15.013095 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c221c0b2-db8b-4e99-aad0-4a50bb425461 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:15.013873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c221c0b2-db8b-4e99-aad0-4a50bb425461 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:15.014333 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c221c0b2-db8b-4e99-aad0-4a50bb425461 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:15.014760 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c221c0b2-db8b-4e99-aad0-4a50bb425461 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:15.226632 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c221c0b2-db8b-4e99-aad0-4a50bb425461 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:15.234958 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c221c0b2-db8b-4e99-aad0-4a50bb425461 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:15.236463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c221c0b2-db8b-4e99-aad0-4a50bb425461 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:15.237649 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c221c0b2-db8b-4e99-aad0-4a50bb425461 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1721 microversion: 2.20 time: 0.238105 Aug 24 09:01:15.238240 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 333/661] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:14 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:15.412645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5e8859fe-23ff-4b8e-bd10-f39ea8907f72 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:15.414280 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5e8859fe-23ff-4b8e-bd10-f39ea8907f72 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:15.421530 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e8859fe-23ff-4b8e-bd10-f39ea8907f72 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:15.422015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e8859fe-23ff-4b8e-bd10-f39ea8907f72 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:15.422441 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e8859fe-23ff-4b8e-bd10-f39ea8907f72 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:15.423155 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e8859fe-23ff-4b8e-bd10-f39ea8907f72 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:15.423601 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e8859fe-23ff-4b8e-bd10-f39ea8907f72 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:15.424015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e8859fe-23ff-4b8e-bd10-f39ea8907f72 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:15.571979 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5e8859fe-23ff-4b8e-bd10-f39ea8907f72 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:15.580235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5e8859fe-23ff-4b8e-bd10-f39ea8907f72 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1366 microversion: 2.1 time: 0.172387 Aug 24 09:01:15.580861 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 329/662] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:15 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:16.281709 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1d574d54-be17-4fb8-992a-06e1a0af872f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:16.281709 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1d574d54-be17-4fb8-992a-06e1a0af872f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:16.283524 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d574d54-be17-4fb8-992a-06e1a0af872f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:16.283992 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d574d54-be17-4fb8-992a-06e1a0af872f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:16.284424 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d574d54-be17-4fb8-992a-06e1a0af872f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:16.285152 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d574d54-be17-4fb8-992a-06e1a0af872f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:16.285608 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d574d54-be17-4fb8-992a-06e1a0af872f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:16.286009 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d574d54-be17-4fb8-992a-06e1a0af872f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:16.449896 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1d574d54-be17-4fb8-992a-06e1a0af872f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:16.459843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1d574d54-be17-4fb8-992a-06e1a0af872f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:16.463855 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1d574d54-be17-4fb8-992a-06e1a0af872f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:16.474391 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1d574d54-be17-4fb8-992a-06e1a0af872f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1724 microversion: 2.20 time: 0.205259 Aug 24 09:01:16.477074 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 334/663] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:16 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:16.503500 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a8de588d-8d1a-44d1-94ce-b6183a0e1289 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5145e73e-2994-4799-95fa-d1ed63ca633f"}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:16.509226 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a8de588d-8d1a-44d1-94ce-b6183a0e1289 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:16.526124 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a8de588d-8d1a-44d1-94ce-b6183a0e1289 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:16.526983 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a8de588d-8d1a-44d1-94ce-b6183a0e1289 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:16.527508 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a8de588d-8d1a-44d1-94ce-b6183a0e1289 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:16.529333 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a8de588d-8d1a-44d1-94ce-b6183a0e1289 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:16.532138 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a8de588d-8d1a-44d1-94ce-b6183a0e1289 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:16.539192 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a8de588d-8d1a-44d1-94ce-b6183a0e1289 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:16.601772 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1aaa459c-3030-4e89-8d77-400797f99671 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:16.602362 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1aaa459c-3030-4e89-8d77-400797f99671 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:16.612180 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1aaa459c-3030-4e89-8d77-400797f99671 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:16.612742 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1aaa459c-3030-4e89-8d77-400797f99671 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:16.613195 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1aaa459c-3030-4e89-8d77-400797f99671 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:16.613895 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1aaa459c-3030-4e89-8d77-400797f99671 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:16.614577 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1aaa459c-3030-4e89-8d77-400797f99671 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:16.615010 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1aaa459c-3030-4e89-8d77-400797f99671 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:16.795705 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1aaa459c-3030-4e89-8d77-400797f99671 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:16.807983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1aaa459c-3030-4e89-8d77-400797f99671 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1556 microversion: 2.1 time: 0.210205 Aug 24 09:01:16.816259 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 335/664] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:16 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1556 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:16.845595 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a0357600-76f4-4d8f-baf1-a51d031270cc tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:16.846493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a0357600-76f4-4d8f-baf1-a51d031270cc tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:16.854560 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0357600-76f4-4d8f-baf1-a51d031270cc tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:16.857251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0357600-76f4-4d8f-baf1-a51d031270cc tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:16.857251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0357600-76f4-4d8f-baf1-a51d031270cc tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:16.857251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0357600-76f4-4d8f-baf1-a51d031270cc tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:16.857251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0357600-76f4-4d8f-baf1-a51d031270cc tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:16.857652 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a0357600-76f4-4d8f-baf1-a51d031270cc tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:16.943324 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a0357600-76f4-4d8f-baf1-a51d031270cc tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106680 Aug 24 09:01:16.943984 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 336/665] 10.222.0.55 () {58 vars in 1275 bytes} [Wed Aug 24 09:01:16 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:01:18.019977 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a8de588d-8d1a-44d1-94ce-b6183a0e1289 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "POST /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.520450 Aug 24 09:01:18.026235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 330/666] 10.222.0.55 () {62 vars in 1364 bytes} [Wed Aug 24 09:01:16 2022] POST /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-volume_attachments => generated 188 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:01:18.248366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8223bea5-bca1-4d65-b214-4006805b3b98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:18.249684 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8223bea5-bca1-4d65-b214-4006805b3b98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:18.257786 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8223bea5-bca1-4d65-b214-4006805b3b98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:18.258578 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8223bea5-bca1-4d65-b214-4006805b3b98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:18.259016 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8223bea5-bca1-4d65-b214-4006805b3b98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:18.260278 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8223bea5-bca1-4d65-b214-4006805b3b98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:18.260959 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8223bea5-bca1-4d65-b214-4006805b3b98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:18.261372 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8223bea5-bca1-4d65-b214-4006805b3b98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:18.429552 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8223bea5-bca1-4d65-b214-4006805b3b98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132984) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 09:01:18.564642 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-b3a5696d-4526-4416-960f-a258bc34d5c4 req-8a29c8ea-b97f-4439-98c2-5b6fd10788b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "713b8af9-0654-40a5-bae9-0592267a0458", "tag": "a8514a53-9b36-48eb-9c4f-354a332273c4"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:18.596829 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-b3a5696d-4526-4416-960f-a258bc34d5c4 req-8a29c8ea-b97f-4439-98c2-5b6fd10788b6 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:18.596829 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-b3a5696d-4526-4416-960f-a258bc34d5c4 req-8a29c8ea-b97f-4439-98c2-5b6fd10788b6 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:18.596829 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-b3a5696d-4526-4416-960f-a258bc34d5c4 req-8a29c8ea-b97f-4439-98c2-5b6fd10788b6 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:18.599121 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:18.601954 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-b3a5696d-4526-4416-960f-a258bc34d5c4 req-8a29c8ea-b97f-4439-98c2-5b6fd10788b6 service nova] Creating event network-changed:a8514a53-9b36-48eb-9c4f-354a332273c4 for instance 713b8af9-0654-40a5-bae9-0592267a0458 on hv-cinder-85221 Aug 24 09:01:18.617983 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-b3a5696d-4526-4416-960f-a258bc34d5c4 req-8a29c8ea-b97f-4439-98c2-5b6fd10788b6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155809 Aug 24 09:01:18.628056 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 331/667] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:01:19.497616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8223bea5-bca1-4d65-b214-4006805b3b98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "POST /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/action" status: 202 len: 0 microversion: 2.20 time: 1.255715 Aug 24 09:01:19.503942 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 337/668] 10.222.0.55 () {62 vars in 1319 bytes} [Wed Aug 24 09:01:18 2022] POST /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/action => generated 0 bytes in 1263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:01:19.518169 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-993f253a-8d82-4991-b51d-8cbf7435111b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:19.519571 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-993f253a-8d82-4991-b51d-8cbf7435111b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:19.532971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=82 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:19.550168 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-993f253a-8d82-4991-b51d-8cbf7435111b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:19.564423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-993f253a-8d82-4991-b51d-8cbf7435111b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:19.565758 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-993f253a-8d82-4991-b51d-8cbf7435111b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:19.567243 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-993f253a-8d82-4991-b51d-8cbf7435111b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:19.568252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-993f253a-8d82-4991-b51d-8cbf7435111b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:19.569219 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-993f253a-8d82-4991-b51d-8cbf7435111b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:19.896979 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-993f253a-8d82-4991-b51d-8cbf7435111b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:19.917633 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-993f253a-8d82-4991-b51d-8cbf7435111b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:19.921656 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-993f253a-8d82-4991-b51d-8cbf7435111b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:19.925315 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-993f253a-8d82-4991-b51d-8cbf7435111b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1750 microversion: 2.20 time: 0.419900 Aug 24 09:01:19.940876 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 332/669] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:19 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1750 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:20.861866 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-67ab8233-d95a-4c0a-b14a-775ce1f0dd56 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Action: 'create', calling method: .version_select at 0x7f16ae4b30d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1390868443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWNk9wNG2Iufzq4kFFv/oPmn1pli8KUxBlJdyuR1vv1ZVQt0FUrAZ6te8zhi40/5g7k4VoHnY0IyH1uDp4mUZTjJvSzLThMyDIhLprMU58tBLbIJwO8i+z+tvz5LjNpXg=="}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:20.878887 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-67ab8233-d95a-4c0a-b14a-775ce1f0dd56 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Getting quotas for project eccd422b1e434b56ba0e0a31aebebd98. Resources: {'key_pairs'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:01:20.884769 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-67ab8233-d95a-4c0a-b14a-775ce1f0dd56 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Getting quotas for user 095ae2b97081460da5d3da2366a604c3 and project eccd422b1e434b56ba0e0a31aebebd98. Resources: {'key_pairs'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:01:20.956688 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-620b4c04-aed7-40fe-b7c4-ee80f22d1406 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:20.957521 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-620b4c04-aed7-40fe-b7c4-ee80f22d1406 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:20.965214 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-620b4c04-aed7-40fe-b7c4-ee80f22d1406 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:20.965768 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-620b4c04-aed7-40fe-b7c4-ee80f22d1406 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:20.966206 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-620b4c04-aed7-40fe-b7c4-ee80f22d1406 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:20.966969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-620b4c04-aed7-40fe-b7c4-ee80f22d1406 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:20.967423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-620b4c04-aed7-40fe-b7c4-ee80f22d1406 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:20.967847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-620b4c04-aed7-40fe-b7c4-ee80f22d1406 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:21.016334 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-67ab8233-d95a-4c0a-b14a-775ce1f0dd56 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.159029 Aug 24 09:01:21.018113 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 338/670] 10.222.0.55 () {60 vars in 1159 bytes} [Wed Aug 24 09:01:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:01:21.123628 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-620b4c04-aed7-40fe-b7c4-ee80f22d1406 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:21.126296 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1343115539", "imageRef": "279c813f-760f-468c-9b31-2c1b84832db0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1390868443", "networks": [{"uuid": "988828a3-906e-4c96-bc56-e9dc470c3bf5"}]}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:21.133840 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-620b4c04-aed7-40fe-b7c4-ee80f22d1406 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:21.136115 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-620b4c04-aed7-40fe-b7c4-ee80f22d1406 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:21.137426 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-620b4c04-aed7-40fe-b7c4-ee80f22d1406 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1750 microversion: 2.20 time: 0.185192 Aug 24 09:01:21.138074 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 333/671] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:20 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:21.218132 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.network.neutron [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] validate_networks() for [('988828a3-906e-4c96-bc56-e9dc470c3bf5', None, None, None, None, None)] {{(pid=132984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:01:21.711012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Flavor limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:01:21.711508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Image limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:01:21.712139 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Flavor pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:01:21.713673 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Image pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:01:21.714303 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:01:21.726481 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:21.727115 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:21.727607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:21.733075 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:21.733075 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:21.733075 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:21.751372 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Getting quotas for project eccd422b1e434b56ba0e0a31aebebd98. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:01:21.756136 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Getting quotas for user 095ae2b97081460da5d3da2366a604c3 and project eccd422b1e434b56ba0e0a31aebebd98. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:01:21.770735 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Going to run 1 instances... {{(pid=132984) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:01:21.773882 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='279c813f-760f-468c-9b31-2c1b84832db0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:01:21.787765 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:21.955154 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8c1dde23-864c-4a38-a6d8-05933d5eee87 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849245 Aug 24 09:01:21.956078 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 339/672] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 09:01:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:01:21.966940 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0ab95ffe-1bb1-4088-b6fa-178d3d5b630f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:21.967540 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0ab95ffe-1bb1-4088-b6fa-178d3d5b630f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:22.024943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0ab95ffe-1bb1-4088-b6fa-178d3d5b630f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:22.033395 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0ab95ffe-1bb1-4088-b6fa-178d3d5b630f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1259 microversion: 2.1 time: 0.070256 Aug 24 09:01:22.035880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 334/673] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:21 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:22.161994 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-761fd148-0f6a-464d-a6a7-53452822904e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:22.162707 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-761fd148-0f6a-464d-a6a7-53452822904e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:22.169726 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-761fd148-0f6a-464d-a6a7-53452822904e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:22.170187 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-761fd148-0f6a-464d-a6a7-53452822904e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:22.170539 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-761fd148-0f6a-464d-a6a7-53452822904e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:22.171435 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-761fd148-0f6a-464d-a6a7-53452822904e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:22.171923 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-761fd148-0f6a-464d-a6a7-53452822904e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:22.172354 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-761fd148-0f6a-464d-a6a7-53452822904e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:22.313548 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-761fd148-0f6a-464d-a6a7-53452822904e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:22.322688 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-761fd148-0f6a-464d-a6a7-53452822904e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:22.324226 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-761fd148-0f6a-464d-a6a7-53452822904e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:22.325409 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-761fd148-0f6a-464d-a6a7-53452822904e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1750 microversion: 2.20 time: 0.168274 Aug 24 09:01:22.325991 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 340/674] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:22 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:23.054940 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9a429e27-4245-4ebe-92b6-6d0a74c02563 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:23.055630 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9a429e27-4245-4ebe-92b6-6d0a74c02563 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:23.115184 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9a429e27-4245-4ebe-92b6-6d0a74c02563 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:23.122947 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9a429e27-4245-4ebe-92b6-6d0a74c02563 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1259 microversion: 2.1 time: 0.071857 Aug 24 09:01:23.123531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 335/675] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:23 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:23.349788 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-902e3db2-7de8-489a-ac61-fbb6f7cd0a1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:23.350432 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-902e3db2-7de8-489a-ac61-fbb6f7cd0a1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:23.357831 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-902e3db2-7de8-489a-ac61-fbb6f7cd0a1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:23.358310 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-902e3db2-7de8-489a-ac61-fbb6f7cd0a1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:23.358742 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-902e3db2-7de8-489a-ac61-fbb6f7cd0a1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:23.359437 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-902e3db2-7de8-489a-ac61-fbb6f7cd0a1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:23.359982 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-902e3db2-7de8-489a-ac61-fbb6f7cd0a1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:23.360483 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-902e3db2-7de8-489a-ac61-fbb6f7cd0a1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:23.509550 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-902e3db2-7de8-489a-ac61-fbb6f7cd0a1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:23.519250 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-902e3db2-7de8-489a-ac61-fbb6f7cd0a1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:23.520790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-902e3db2-7de8-489a-ac61-fbb6f7cd0a1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:23.521987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-902e3db2-7de8-489a-ac61-fbb6f7cd0a1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1752 microversion: 2.20 time: 0.176612 Aug 24 09:01:23.522546 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 341/676] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:23 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:24.149065 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e120aee9-cd9c-4c8e-a2c3-809ac96cb7d3 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:24.149971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e120aee9-cd9c-4c8e-a2c3-809ac96cb7d3 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:24.158181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e120aee9-cd9c-4c8e-a2c3-809ac96cb7d3 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:24.158666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e120aee9-cd9c-4c8e-a2c3-809ac96cb7d3 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:24.159164 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e120aee9-cd9c-4c8e-a2c3-809ac96cb7d3 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:24.159904 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e120aee9-cd9c-4c8e-a2c3-809ac96cb7d3 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:24.160564 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e120aee9-cd9c-4c8e-a2c3-809ac96cb7d3 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:24.161002 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e120aee9-cd9c-4c8e-a2c3-809ac96cb7d3 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:24.226175 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e120aee9-cd9c-4c8e-a2c3-809ac96cb7d3 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:24.234838 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e120aee9-cd9c-4c8e-a2c3-809ac96cb7d3 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1311 microversion: 2.1 time: 0.089807 Aug 24 09:01:24.235430 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 336/677] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:24 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:24.547516 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-42954d09-6c3b-47cc-80ac-f61bfeba8b7a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:24.548186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-42954d09-6c3b-47cc-80ac-f61bfeba8b7a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:24.555208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-42954d09-6c3b-47cc-80ac-f61bfeba8b7a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:24.560445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-42954d09-6c3b-47cc-80ac-f61bfeba8b7a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:24.560445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-42954d09-6c3b-47cc-80ac-f61bfeba8b7a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:24.560445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-42954d09-6c3b-47cc-80ac-f61bfeba8b7a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:24.560445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-42954d09-6c3b-47cc-80ac-f61bfeba8b7a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:24.560909 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-42954d09-6c3b-47cc-80ac-f61bfeba8b7a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:24.693770 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-42954d09-6c3b-47cc-80ac-f61bfeba8b7a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:24.702960 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-42954d09-6c3b-47cc-80ac-f61bfeba8b7a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:24.704603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-42954d09-6c3b-47cc-80ac-f61bfeba8b7a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:24.705621 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-42954d09-6c3b-47cc-80ac-f61bfeba8b7a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.162201 Aug 24 09:01:24.706184 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 342/678] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:24 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:25.256702 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3608adf0-45ab-4bc4-a0c8-549893581f5e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:25.257550 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3608adf0-45ab-4bc4-a0c8-549893581f5e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:25.265847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3608adf0-45ab-4bc4-a0c8-549893581f5e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:25.266430 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3608adf0-45ab-4bc4-a0c8-549893581f5e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:25.266970 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3608adf0-45ab-4bc4-a0c8-549893581f5e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:25.267750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3608adf0-45ab-4bc4-a0c8-549893581f5e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:25.268274 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3608adf0-45ab-4bc4-a0c8-549893581f5e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:25.268931 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3608adf0-45ab-4bc4-a0c8-549893581f5e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:25.363155 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3608adf0-45ab-4bc4-a0c8-549893581f5e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:25.378796 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3608adf0-45ab-4bc4-a0c8-549893581f5e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1319 microversion: 2.1 time: 0.125354 Aug 24 09:01:25.379771 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 337/679] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:25 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1319 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:25.729716 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-26afda5c-bc24-41bf-9824-d4e01dd5d5d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:25.730668 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-26afda5c-bc24-41bf-9824-d4e01dd5d5d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:25.740103 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-26afda5c-bc24-41bf-9824-d4e01dd5d5d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:25.745571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-26afda5c-bc24-41bf-9824-d4e01dd5d5d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:25.745571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-26afda5c-bc24-41bf-9824-d4e01dd5d5d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:25.745571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-26afda5c-bc24-41bf-9824-d4e01dd5d5d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:25.745571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-26afda5c-bc24-41bf-9824-d4e01dd5d5d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:25.746017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-26afda5c-bc24-41bf-9824-d4e01dd5d5d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:26.024585 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-26afda5c-bc24-41bf-9824-d4e01dd5d5d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:26.038426 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-26afda5c-bc24-41bf-9824-d4e01dd5d5d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:26.038752 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-26afda5c-bc24-41bf-9824-d4e01dd5d5d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:26.039938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-26afda5c-bc24-41bf-9824-d4e01dd5d5d8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.314527 Aug 24 09:01:26.040551 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 343/680] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:25 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:26.414688 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2acca539-224f-412c-951b-ee018d6b440f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:26.416803 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2acca539-224f-412c-951b-ee018d6b440f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:26.426460 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2acca539-224f-412c-951b-ee018d6b440f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:26.427248 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2acca539-224f-412c-951b-ee018d6b440f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:26.427781 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2acca539-224f-412c-951b-ee018d6b440f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:26.428622 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2acca539-224f-412c-951b-ee018d6b440f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:26.429222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2acca539-224f-412c-951b-ee018d6b440f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:26.429739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2acca539-224f-412c-951b-ee018d6b440f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:26.656502 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2acca539-224f-412c-951b-ee018d6b440f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:26.680816 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2acca539-224f-412c-951b-ee018d6b440f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.270435 Aug 24 09:01:26.681423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 338/681] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:26 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:27.063758 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6df225d0-6ea6-496d-a02b-0907c6af76fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:27.064406 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6df225d0-6ea6-496d-a02b-0907c6af76fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:27.072320 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6df225d0-6ea6-496d-a02b-0907c6af76fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:27.073290 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6df225d0-6ea6-496d-a02b-0907c6af76fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:27.074036 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6df225d0-6ea6-496d-a02b-0907c6af76fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:27.075298 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6df225d0-6ea6-496d-a02b-0907c6af76fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:27.076051 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6df225d0-6ea6-496d-a02b-0907c6af76fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:27.076815 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6df225d0-6ea6-496d-a02b-0907c6af76fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:27.294772 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6df225d0-6ea6-496d-a02b-0907c6af76fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:27.304747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6df225d0-6ea6-496d-a02b-0907c6af76fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:27.306323 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6df225d0-6ea6-496d-a02b-0907c6af76fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:27.307541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6df225d0-6ea6-496d-a02b-0907c6af76fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.247910 Aug 24 09:01:27.308436 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 344/682] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:27 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:27.703325 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fe8ecb3e-56d3-41a0-9393-26f77fb7c19f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:27.703888 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-fe8ecb3e-56d3-41a0-9393-26f77fb7c19f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:27.710371 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fe8ecb3e-56d3-41a0-9393-26f77fb7c19f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:27.710840 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fe8ecb3e-56d3-41a0-9393-26f77fb7c19f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:27.711263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fe8ecb3e-56d3-41a0-9393-26f77fb7c19f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:27.711960 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fe8ecb3e-56d3-41a0-9393-26f77fb7c19f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:27.712404 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fe8ecb3e-56d3-41a0-9393-26f77fb7c19f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:27.712847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fe8ecb3e-56d3-41a0-9393-26f77fb7c19f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:27.869411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fe8ecb3e-56d3-41a0-9393-26f77fb7c19f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:27.883449 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fe8ecb3e-56d3-41a0-9393-26f77fb7c19f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.183580 Aug 24 09:01:27.884785 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 339/683] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:27 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:28.331731 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1630176e-0907-4dcc-a10e-0b8a34babccc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:28.332356 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1630176e-0907-4dcc-a10e-0b8a34babccc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:28.339613 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1630176e-0907-4dcc-a10e-0b8a34babccc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:28.340089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1630176e-0907-4dcc-a10e-0b8a34babccc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:28.340515 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1630176e-0907-4dcc-a10e-0b8a34babccc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:28.341231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1630176e-0907-4dcc-a10e-0b8a34babccc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:28.341748 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1630176e-0907-4dcc-a10e-0b8a34babccc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:28.342161 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1630176e-0907-4dcc-a10e-0b8a34babccc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:28.492602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1630176e-0907-4dcc-a10e-0b8a34babccc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:28.503593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1630176e-0907-4dcc-a10e-0b8a34babccc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:28.505500 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1630176e-0907-4dcc-a10e-0b8a34babccc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:28.506906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1630176e-0907-4dcc-a10e-0b8a34babccc tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.179306 Aug 24 09:01:28.507496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 345/684] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:28 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:28.908263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8e5e0795-3a96-4b7d-851f-7f8cdd3ae012 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:28.909051 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8e5e0795-3a96-4b7d-851f-7f8cdd3ae012 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:28.918111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8e5e0795-3a96-4b7d-851f-7f8cdd3ae012 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:28.918814 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8e5e0795-3a96-4b7d-851f-7f8cdd3ae012 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:28.919237 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8e5e0795-3a96-4b7d-851f-7f8cdd3ae012 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:28.920174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8e5e0795-3a96-4b7d-851f-7f8cdd3ae012 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:28.920683 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8e5e0795-3a96-4b7d-851f-7f8cdd3ae012 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:28.921287 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8e5e0795-3a96-4b7d-851f-7f8cdd3ae012 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:29.112051 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8e5e0795-3a96-4b7d-851f-7f8cdd3ae012 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:29.124384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8e5e0795-3a96-4b7d-851f-7f8cdd3ae012 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.221092 Aug 24 09:01:29.126578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 340/685] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:28 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:29.533322 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e5760b8d-4100-4b36-90c8-fa5cdf4b161e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:29.533930 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e5760b8d-4100-4b36-90c8-fa5cdf4b161e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:29.541026 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e5760b8d-4100-4b36-90c8-fa5cdf4b161e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:29.541508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e5760b8d-4100-4b36-90c8-fa5cdf4b161e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:29.541965 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e5760b8d-4100-4b36-90c8-fa5cdf4b161e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:29.542735 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e5760b8d-4100-4b36-90c8-fa5cdf4b161e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:29.543185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e5760b8d-4100-4b36-90c8-fa5cdf4b161e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:29.543596 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e5760b8d-4100-4b36-90c8-fa5cdf4b161e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:29.707135 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e5760b8d-4100-4b36-90c8-fa5cdf4b161e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:29.716532 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e5760b8d-4100-4b36-90c8-fa5cdf4b161e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:29.718655 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e5760b8d-4100-4b36-90c8-fa5cdf4b161e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:29.720184 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e5760b8d-4100-4b36-90c8-fa5cdf4b161e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.191275 Aug 24 09:01:29.721209 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 346/686] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:29 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:30.148176 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9a0ca7f9-02d6-4c6f-9701-ba03e81d72be tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:30.150219 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9a0ca7f9-02d6-4c6f-9701-ba03e81d72be tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:30.157654 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a0ca7f9-02d6-4c6f-9701-ba03e81d72be tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:30.164122 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a0ca7f9-02d6-4c6f-9701-ba03e81d72be tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:30.164122 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a0ca7f9-02d6-4c6f-9701-ba03e81d72be tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:30.164122 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a0ca7f9-02d6-4c6f-9701-ba03e81d72be tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:30.164122 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a0ca7f9-02d6-4c6f-9701-ba03e81d72be tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:30.164527 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a0ca7f9-02d6-4c6f-9701-ba03e81d72be tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:30.324743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9a0ca7f9-02d6-4c6f-9701-ba03e81d72be tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:30.333897 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9a0ca7f9-02d6-4c6f-9701-ba03e81d72be tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.189912 Aug 24 09:01:30.336809 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 341/687] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:30 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:30.877186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-541c1b67-e7a9-4d54-b5de-0d60de690652 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:30.877186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-541c1b67-e7a9-4d54-b5de-0d60de690652 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:30.877186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-541c1b67-e7a9-4d54-b5de-0d60de690652 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:30.877186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-541c1b67-e7a9-4d54-b5de-0d60de690652 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:30.878275 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-541c1b67-e7a9-4d54-b5de-0d60de690652 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:30.878275 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-541c1b67-e7a9-4d54-b5de-0d60de690652 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:30.878275 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-541c1b67-e7a9-4d54-b5de-0d60de690652 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:30.878275 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-541c1b67-e7a9-4d54-b5de-0d60de690652 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:30.879167 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:30.920026 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-541c1b67-e7a9-4d54-b5de-0d60de690652 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:30.929166 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-541c1b67-e7a9-4d54-b5de-0d60de690652 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:30.931316 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-541c1b67-e7a9-4d54-b5de-0d60de690652 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:30.932590 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-541c1b67-e7a9-4d54-b5de-0d60de690652 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.191398 Aug 24 09:01:30.933157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 347/688] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:30 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:31.373490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-049c3a9e-8209-4d81-b105-c1e77a09dd85 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:31.374144 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-049c3a9e-8209-4d81-b105-c1e77a09dd85 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:31.380276 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-049c3a9e-8209-4d81-b105-c1e77a09dd85 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:31.380804 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-049c3a9e-8209-4d81-b105-c1e77a09dd85 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:31.381232 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-049c3a9e-8209-4d81-b105-c1e77a09dd85 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:31.381923 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-049c3a9e-8209-4d81-b105-c1e77a09dd85 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:31.382362 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-049c3a9e-8209-4d81-b105-c1e77a09dd85 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:31.382976 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-049c3a9e-8209-4d81-b105-c1e77a09dd85 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:31.531854 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-049c3a9e-8209-4d81-b105-c1e77a09dd85 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:31.541079 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-049c3a9e-8209-4d81-b105-c1e77a09dd85 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.177433 Aug 24 09:01:31.541672 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 342/689] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:31 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:31.959624 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d67e2624-4b5f-4e46-8b96-7a4b94ddef19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:31.960274 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d67e2624-4b5f-4e46-8b96-7a4b94ddef19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:31.962867 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:31.964070 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=10 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:31.969749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d67e2624-4b5f-4e46-8b96-7a4b94ddef19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:31.970245 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d67e2624-4b5f-4e46-8b96-7a4b94ddef19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:31.970749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d67e2624-4b5f-4e46-8b96-7a4b94ddef19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:31.971605 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d67e2624-4b5f-4e46-8b96-7a4b94ddef19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:31.972152 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d67e2624-4b5f-4e46-8b96-7a4b94ddef19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:31.972678 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d67e2624-4b5f-4e46-8b96-7a4b94ddef19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:32.125881 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d67e2624-4b5f-4e46-8b96-7a4b94ddef19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:32.135679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d67e2624-4b5f-4e46-8b96-7a4b94ddef19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:32.137246 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d67e2624-4b5f-4e46-8b96-7a4b94ddef19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:32.138401 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d67e2624-4b5f-4e46-8b96-7a4b94ddef19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.183951 Aug 24 09:01:32.138980 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 348/690] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:31 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:32.574566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c313395b-cd08-4e6b-af74-b08617511c0f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:32.575330 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c313395b-cd08-4e6b-af74-b08617511c0f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:32.582585 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c313395b-cd08-4e6b-af74-b08617511c0f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:32.583060 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c313395b-cd08-4e6b-af74-b08617511c0f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:32.583486 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c313395b-cd08-4e6b-af74-b08617511c0f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:32.584181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c313395b-cd08-4e6b-af74-b08617511c0f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:32.584649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c313395b-cd08-4e6b-af74-b08617511c0f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:32.585058 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c313395b-cd08-4e6b-af74-b08617511c0f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:32.826336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c313395b-cd08-4e6b-af74-b08617511c0f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:32.826336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c313395b-cd08-4e6b-af74-b08617511c0f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.158980 Aug 24 09:01:32.826336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 343/691] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:32 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:33.162438 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-897e8803-30ac-424d-b8c0-f780d56c01f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:33.163082 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-897e8803-30ac-424d-b8c0-f780d56c01f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:33.172793 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-897e8803-30ac-424d-b8c0-f780d56c01f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:33.173365 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-897e8803-30ac-424d-b8c0-f780d56c01f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:33.173880 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-897e8803-30ac-424d-b8c0-f780d56c01f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:33.174628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-897e8803-30ac-424d-b8c0-f780d56c01f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:33.175093 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-897e8803-30ac-424d-b8c0-f780d56c01f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:33.175709 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-897e8803-30ac-424d-b8c0-f780d56c01f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:33.323789 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-897e8803-30ac-424d-b8c0-f780d56c01f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:33.334430 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-897e8803-30ac-424d-b8c0-f780d56c01f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:33.336321 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-897e8803-30ac-424d-b8c0-f780d56c01f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:33.338354 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-897e8803-30ac-424d-b8c0-f780d56c01f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.180219 Aug 24 09:01:33.339779 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 349/692] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:33 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:33.844722 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cdd9064b-3e10-4fe4-a756-69a08fe11ccf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:33.845380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-cdd9064b-3e10-4fe4-a756-69a08fe11ccf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:33.847189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=4 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:33.852967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cdd9064b-3e10-4fe4-a756-69a08fe11ccf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:33.853354 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cdd9064b-3e10-4fe4-a756-69a08fe11ccf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:33.853789 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cdd9064b-3e10-4fe4-a756-69a08fe11ccf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:33.854509 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cdd9064b-3e10-4fe4-a756-69a08fe11ccf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:33.854948 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cdd9064b-3e10-4fe4-a756-69a08fe11ccf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:33.855360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cdd9064b-3e10-4fe4-a756-69a08fe11ccf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:34.011491 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-cdd9064b-3e10-4fe4-a756-69a08fe11ccf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:34.020192 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-cdd9064b-3e10-4fe4-a756-69a08fe11ccf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.179301 Aug 24 09:01:34.020926 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 344/693] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:33 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:34.362597 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-dfa68d5f-623d-4033-80a5-62eb8ad29db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:34.363530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-dfa68d5f-623d-4033-80a5-62eb8ad29db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:34.371251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dfa68d5f-623d-4033-80a5-62eb8ad29db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:34.375411 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dfa68d5f-623d-4033-80a5-62eb8ad29db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:34.375411 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dfa68d5f-623d-4033-80a5-62eb8ad29db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:34.375411 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dfa68d5f-623d-4033-80a5-62eb8ad29db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:34.375411 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dfa68d5f-623d-4033-80a5-62eb8ad29db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:34.375869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dfa68d5f-623d-4033-80a5-62eb8ad29db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:34.532634 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-dfa68d5f-623d-4033-80a5-62eb8ad29db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:34.542386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-dfa68d5f-623d-4033-80a5-62eb8ad29db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:34.543891 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-dfa68d5f-623d-4033-80a5-62eb8ad29db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:34.545133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-dfa68d5f-623d-4033-80a5-62eb8ad29db0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.186539 Aug 24 09:01:34.545909 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 350/694] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:34 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:35.044741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-05f508d8-3518-43a7-b3a5-c5b5c7a65e4c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:35.147254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-05f508d8-3518-43a7-b3a5-c5b5c7a65e4c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:35.147254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05f508d8-3518-43a7-b3a5-c5b5c7a65e4c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:35.147254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05f508d8-3518-43a7-b3a5-c5b5c7a65e4c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:35.147254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05f508d8-3518-43a7-b3a5-c5b5c7a65e4c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:35.147974 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05f508d8-3518-43a7-b3a5-c5b5c7a65e4c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:35.147974 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05f508d8-3518-43a7-b3a5-c5b5c7a65e4c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:35.147974 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-05f508d8-3518-43a7-b3a5-c5b5c7a65e4c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:35.249237 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-05f508d8-3518-43a7-b3a5-c5b5c7a65e4c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:35.261765 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-05f508d8-3518-43a7-b3a5-c5b5c7a65e4c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.221164 Aug 24 09:01:35.262991 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 345/695] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:35 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:35.575369 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-53350bef-bcea-4d92-a4a3-6ed689a89bfe tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:35.576404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-53350bef-bcea-4d92-a4a3-6ed689a89bfe tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:35.586409 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-53350bef-bcea-4d92-a4a3-6ed689a89bfe tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:35.588339 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-53350bef-bcea-4d92-a4a3-6ed689a89bfe tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:35.589409 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-53350bef-bcea-4d92-a4a3-6ed689a89bfe tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:35.591422 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-53350bef-bcea-4d92-a4a3-6ed689a89bfe tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:35.592588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-53350bef-bcea-4d92-a4a3-6ed689a89bfe tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:35.593565 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-53350bef-bcea-4d92-a4a3-6ed689a89bfe tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:35.817645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-53350bef-bcea-4d92-a4a3-6ed689a89bfe tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:35.833793 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-53350bef-bcea-4d92-a4a3-6ed689a89bfe tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:35.837457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-53350bef-bcea-4d92-a4a3-6ed689a89bfe tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:35.839220 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-53350bef-bcea-4d92-a4a3-6ed689a89bfe tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.273563 Aug 24 09:01:35.840155 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 351/696] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:35 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:36.297677 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-be61b4f8-411d-4ae2-a0a6-a2a4a462d934 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:36.298579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-be61b4f8-411d-4ae2-a0a6-a2a4a462d934 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:36.307355 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be61b4f8-411d-4ae2-a0a6-a2a4a462d934 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:36.307857 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be61b4f8-411d-4ae2-a0a6-a2a4a462d934 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:36.308357 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be61b4f8-411d-4ae2-a0a6-a2a4a462d934 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:36.309200 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be61b4f8-411d-4ae2-a0a6-a2a4a462d934 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:36.309713 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be61b4f8-411d-4ae2-a0a6-a2a4a462d934 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:36.310243 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be61b4f8-411d-4ae2-a0a6-a2a4a462d934 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:36.459121 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-be61b4f8-411d-4ae2-a0a6-a2a4a462d934 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:36.467594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-be61b4f8-411d-4ae2-a0a6-a2a4a462d934 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.174081 Aug 24 09:01:36.468178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 346/697] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:36 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:36.863728 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-57b6a1a2-3520-4950-b6ec-7c06f3565f72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:36.864426 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-57b6a1a2-3520-4950-b6ec-7c06f3565f72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:36.871089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57b6a1a2-3520-4950-b6ec-7c06f3565f72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:36.872238 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57b6a1a2-3520-4950-b6ec-7c06f3565f72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:36.872238 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57b6a1a2-3520-4950-b6ec-7c06f3565f72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:36.872701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57b6a1a2-3520-4950-b6ec-7c06f3565f72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:36.873154 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57b6a1a2-3520-4950-b6ec-7c06f3565f72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:36.873568 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57b6a1a2-3520-4950-b6ec-7c06f3565f72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:37.016649 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-57b6a1a2-3520-4950-b6ec-7c06f3565f72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:37.026975 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-57b6a1a2-3520-4950-b6ec-7c06f3565f72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:37.029050 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-57b6a1a2-3520-4950-b6ec-7c06f3565f72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:37.030648 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-57b6a1a2-3520-4950-b6ec-7c06f3565f72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.170980 Aug 24 09:01:37.031643 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 352/698] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:36 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:37.491410 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-54724a1c-0ea8-4f1d-b305-7ac182b8df15 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:37.492002 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-54724a1c-0ea8-4f1d-b305-7ac182b8df15 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:37.498805 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54724a1c-0ea8-4f1d-b305-7ac182b8df15 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:37.499313 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54724a1c-0ea8-4f1d-b305-7ac182b8df15 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:37.499772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54724a1c-0ea8-4f1d-b305-7ac182b8df15 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:37.500583 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54724a1c-0ea8-4f1d-b305-7ac182b8df15 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:37.501044 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54724a1c-0ea8-4f1d-b305-7ac182b8df15 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:37.501547 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54724a1c-0ea8-4f1d-b305-7ac182b8df15 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:37.686532 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-54724a1c-0ea8-4f1d-b305-7ac182b8df15 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:37.701163 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-54724a1c-0ea8-4f1d-b305-7ac182b8df15 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.213214 Aug 24 09:01:37.702576 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 347/699] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:37 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:38.054405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7d89651e-a15d-4a85-bf39-7686e07ca2c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:38.055030 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7d89651e-a15d-4a85-bf39-7686e07ca2c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:38.061459 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7d89651e-a15d-4a85-bf39-7686e07ca2c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:38.061942 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7d89651e-a15d-4a85-bf39-7686e07ca2c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:38.062366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7d89651e-a15d-4a85-bf39-7686e07ca2c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:38.063051 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7d89651e-a15d-4a85-bf39-7686e07ca2c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:38.063494 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7d89651e-a15d-4a85-bf39-7686e07ca2c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:38.063914 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7d89651e-a15d-4a85-bf39-7686e07ca2c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:38.209122 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7d89651e-a15d-4a85-bf39-7686e07ca2c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:38.219902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7d89651e-a15d-4a85-bf39-7686e07ca2c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:38.221474 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7d89651e-a15d-4a85-bf39-7686e07ca2c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:38.235031 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7d89651e-a15d-4a85-bf39-7686e07ca2c6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.184072 Aug 24 09:01:38.246293 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 353/700] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:38 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:38.276460 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f02145df-ebb7-4378-8955-310b9eb7dd74 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad33876e-80fa-495d-90e2-8ebf9c9f4a93"}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:38.278963 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f02145df-ebb7-4378-8955-310b9eb7dd74 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:38.286079 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f02145df-ebb7-4378-8955-310b9eb7dd74 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:38.286578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f02145df-ebb7-4378-8955-310b9eb7dd74 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:38.287028 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f02145df-ebb7-4378-8955-310b9eb7dd74 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:38.287741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f02145df-ebb7-4378-8955-310b9eb7dd74 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:38.288198 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f02145df-ebb7-4378-8955-310b9eb7dd74 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:38.288650 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f02145df-ebb7-4378-8955-310b9eb7dd74 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:38.724305 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8307c65b-b4a1-484f-9e89-16b04e9552ed tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:38.724943 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8307c65b-b4a1-484f-9e89-16b04e9552ed tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:38.731784 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8307c65b-b4a1-484f-9e89-16b04e9552ed tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:38.732273 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8307c65b-b4a1-484f-9e89-16b04e9552ed tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:38.732743 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8307c65b-b4a1-484f-9e89-16b04e9552ed tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:38.733488 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8307c65b-b4a1-484f-9e89-16b04e9552ed tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:38.733934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8307c65b-b4a1-484f-9e89-16b04e9552ed tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:38.734361 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8307c65b-b4a1-484f-9e89-16b04e9552ed tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:38.877368 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8307c65b-b4a1-484f-9e89-16b04e9552ed tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:38.886670 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8307c65b-b4a1-484f-9e89-16b04e9552ed tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.166478 Aug 24 09:01:38.887468 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 354/701] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:38 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:39.259649 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-507eb1e3-b8fe-4cdb-b4a0-bafa78f407d0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:39.260316 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-507eb1e3-b8fe-4cdb-b4a0-bafa78f407d0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:39.267159 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-507eb1e3-b8fe-4cdb-b4a0-bafa78f407d0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:39.268072 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-507eb1e3-b8fe-4cdb-b4a0-bafa78f407d0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:39.268072 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-507eb1e3-b8fe-4cdb-b4a0-bafa78f407d0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:39.268830 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-507eb1e3-b8fe-4cdb-b4a0-bafa78f407d0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:39.269279 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-507eb1e3-b8fe-4cdb-b4a0-bafa78f407d0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:39.269702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-507eb1e3-b8fe-4cdb-b4a0-bafa78f407d0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:39.403765 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-507eb1e3-b8fe-4cdb-b4a0-bafa78f407d0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:39.412748 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-507eb1e3-b8fe-4cdb-b4a0-bafa78f407d0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:39.414244 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-507eb1e3-b8fe-4cdb-b4a0-bafa78f407d0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:39.415420 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-507eb1e3-b8fe-4cdb-b4a0-bafa78f407d0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.160470 Aug 24 09:01:39.415977 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 355/702] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:39 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:39.909592 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b46501e5-8320-4d52-8a1b-945e12e1418c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:39.910203 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b46501e5-8320-4d52-8a1b-945e12e1418c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:39.916939 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b46501e5-8320-4d52-8a1b-945e12e1418c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:39.917425 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b46501e5-8320-4d52-8a1b-945e12e1418c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:39.917853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b46501e5-8320-4d52-8a1b-945e12e1418c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:39.918544 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b46501e5-8320-4d52-8a1b-945e12e1418c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:39.918995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b46501e5-8320-4d52-8a1b-945e12e1418c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:39.919423 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b46501e5-8320-4d52-8a1b-945e12e1418c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:40.070011 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b46501e5-8320-4d52-8a1b-945e12e1418c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:40.078405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b46501e5-8320-4d52-8a1b-945e12e1418c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.172789 Aug 24 09:01:40.078997 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 356/703] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:39 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:40.438669 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f77b590f-027f-45d7-afc5-6c63f1ba2178 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:40.439292 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f77b590f-027f-45d7-afc5-6c63f1ba2178 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:40.445762 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f77b590f-027f-45d7-afc5-6c63f1ba2178 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:40.446750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f77b590f-027f-45d7-afc5-6c63f1ba2178 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:40.447180 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f77b590f-027f-45d7-afc5-6c63f1ba2178 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:40.447870 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f77b590f-027f-45d7-afc5-6c63f1ba2178 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:40.448508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f77b590f-027f-45d7-afc5-6c63f1ba2178 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:40.448948 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f77b590f-027f-45d7-afc5-6c63f1ba2178 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:40.581658 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f77b590f-027f-45d7-afc5-6c63f1ba2178 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:40.591071 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f77b590f-027f-45d7-afc5-6c63f1ba2178 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:40.592601 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f77b590f-027f-45d7-afc5-6c63f1ba2178 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:40.593756 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f77b590f-027f-45d7-afc5-6c63f1ba2178 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.159020 Aug 24 09:01:40.594320 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 357/704] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:40 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:41.100723 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-22d7b169-e977-4653-94c0-53831015d3af tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:41.101331 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-22d7b169-e977-4653-94c0-53831015d3af tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:41.107762 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22d7b169-e977-4653-94c0-53831015d3af tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:41.108243 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22d7b169-e977-4653-94c0-53831015d3af tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:41.108703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22d7b169-e977-4653-94c0-53831015d3af tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:41.109394 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22d7b169-e977-4653-94c0-53831015d3af tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:41.109876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22d7b169-e977-4653-94c0-53831015d3af tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:41.110300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22d7b169-e977-4653-94c0-53831015d3af tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:41.239753 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-22d7b169-e977-4653-94c0-53831015d3af tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:41.248208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-22d7b169-e977-4653-94c0-53831015d3af tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.151286 Aug 24 09:01:41.248804 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 358/705] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:41 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:41.616727 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-96b82e74-06e7-4479-89c4-9cb1fe4814d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:41.617365 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-96b82e74-06e7-4479-89c4-9cb1fe4814d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:41.623964 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96b82e74-06e7-4479-89c4-9cb1fe4814d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:41.624445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96b82e74-06e7-4479-89c4-9cb1fe4814d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:41.624901 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96b82e74-06e7-4479-89c4-9cb1fe4814d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:41.625584 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96b82e74-06e7-4479-89c4-9cb1fe4814d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:41.626029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96b82e74-06e7-4479-89c4-9cb1fe4814d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:41.626449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-96b82e74-06e7-4479-89c4-9cb1fe4814d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:41.759935 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-96b82e74-06e7-4479-89c4-9cb1fe4814d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:41.768569 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-96b82e74-06e7-4479-89c4-9cb1fe4814d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:41.770098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-96b82e74-06e7-4479-89c4-9cb1fe4814d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:41.771260 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-96b82e74-06e7-4479-89c4-9cb1fe4814d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.158437 Aug 24 09:01:41.771813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 359/706] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:41 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:42.270350 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0435faa1-26e6-435a-a82e-080da74616c5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:42.270956 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0435faa1-26e6-435a-a82e-080da74616c5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:42.276948 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0435faa1-26e6-435a-a82e-080da74616c5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:42.277423 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0435faa1-26e6-435a-a82e-080da74616c5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:42.277843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0435faa1-26e6-435a-a82e-080da74616c5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:42.278522 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0435faa1-26e6-435a-a82e-080da74616c5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:42.278963 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0435faa1-26e6-435a-a82e-080da74616c5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:42.279376 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0435faa1-26e6-435a-a82e-080da74616c5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:42.420451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0435faa1-26e6-435a-a82e-080da74616c5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:42.420451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0435faa1-26e6-435a-a82e-080da74616c5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.151576 Aug 24 09:01:42.420451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 360/707] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:42 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:42.798560 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9e6944fb-2ae4-40ef-8863-b27af25e25f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:42.799268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9e6944fb-2ae4-40ef-8863-b27af25e25f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:42.806156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e6944fb-2ae4-40ef-8863-b27af25e25f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:42.806633 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e6944fb-2ae4-40ef-8863-b27af25e25f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:42.807061 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e6944fb-2ae4-40ef-8863-b27af25e25f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:42.807756 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e6944fb-2ae4-40ef-8863-b27af25e25f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:42.808203 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e6944fb-2ae4-40ef-8863-b27af25e25f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:42.808642 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e6944fb-2ae4-40ef-8863-b27af25e25f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:42.952699 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9e6944fb-2ae4-40ef-8863-b27af25e25f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:42.960362 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9e6944fb-2ae4-40ef-8863-b27af25e25f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:42.962345 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9e6944fb-2ae4-40ef-8863-b27af25e25f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:42.963541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9e6944fb-2ae4-40ef-8863-b27af25e25f5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.169039 Aug 24 09:01:42.964108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 361/708] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:42 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:43.439777 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0cbd9616-75c4-4385-a3dc-ab69fa8f86da tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:43.440385 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0cbd9616-75c4-4385-a3dc-ab69fa8f86da tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:43.447233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0cbd9616-75c4-4385-a3dc-ab69fa8f86da tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:43.447816 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0cbd9616-75c4-4385-a3dc-ab69fa8f86da tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:43.448168 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0cbd9616-75c4-4385-a3dc-ab69fa8f86da tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:43.448901 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0cbd9616-75c4-4385-a3dc-ab69fa8f86da tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:43.449415 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0cbd9616-75c4-4385-a3dc-ab69fa8f86da tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:43.449785 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0cbd9616-75c4-4385-a3dc-ab69fa8f86da tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:44.125668 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0cbd9616-75c4-4385-a3dc-ab69fa8f86da tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:44.146599 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0cbd9616-75c4-4385-a3dc-ab69fa8f86da tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.710426 Aug 24 09:01:44.148104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 362/709] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:43 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:44.179899 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-123edcd4-6d90-4bc1-946b-13bd0c9d6ab3 req-b056b9b3-0a86-4f5e-b513-cfce701389b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc47a1d8-3769-47c2-b88d-3b75b26eddce", "tag": "8ded112a-e184-4f96-9bf7-0ce179e1f278"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:44.196816 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-123edcd4-6d90-4bc1-946b-13bd0c9d6ab3 req-b056b9b3-0a86-4f5e-b513-cfce701389b0 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:44.200342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-123edcd4-6d90-4bc1-946b-13bd0c9d6ab3 req-b056b9b3-0a86-4f5e-b513-cfce701389b0 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:44.200342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-123edcd4-6d90-4bc1-946b-13bd0c9d6ab3 req-b056b9b3-0a86-4f5e-b513-cfce701389b0 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:44.217068 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-123edcd4-6d90-4bc1-946b-13bd0c9d6ab3 req-b056b9b3-0a86-4f5e-b513-cfce701389b0 service nova] Creating event network-changed:8ded112a-e184-4f96-9bf7-0ce179e1f278 for instance fc47a1d8-3769-47c2-b88d-3b75b26eddce on hv-cinder-85221 Aug 24 09:01:44.223027 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-123edcd4-6d90-4bc1-946b-13bd0c9d6ab3 req-b056b9b3-0a86-4f5e-b513-cfce701389b0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057143 Aug 24 09:01:44.225330 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 363/710] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:01:44.234702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-857d978d-8d0d-4a89-b476-f3ce55f7be9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:44.234702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-857d978d-8d0d-4a89-b476-f3ce55f7be9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:44.239428 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-857d978d-8d0d-4a89-b476-f3ce55f7be9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:44.239965 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-857d978d-8d0d-4a89-b476-f3ce55f7be9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:44.240355 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-857d978d-8d0d-4a89-b476-f3ce55f7be9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:44.241086 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-857d978d-8d0d-4a89-b476-f3ce55f7be9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:44.241689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-857d978d-8d0d-4a89-b476-f3ce55f7be9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:44.242306 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-857d978d-8d0d-4a89-b476-f3ce55f7be9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:44.498413 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-857d978d-8d0d-4a89-b476-f3ce55f7be9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:44.498413 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:44.498413 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-857d978d-8d0d-4a89-b476-f3ce55f7be9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:44.498849 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-857d978d-8d0d-4a89-b476-f3ce55f7be9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:44.498849 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-857d978d-8d0d-4a89-b476-f3ce55f7be9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.269719 Aug 24 09:01:44.498849 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 364/711] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:44 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:44.797727 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f02145df-ebb7-4378-8955-310b9eb7dd74 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "POST /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.718122 Aug 24 09:01:44.798669 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 348/712] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 09:01:38 2022] POST /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-volume_attachments => generated 194 bytes in 6720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:01:45.185929 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6a0fef12-1e9a-43c2-a1f5-f7feae4512d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:45.186664 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6a0fef12-1e9a-43c2-a1f5-f7feae4512d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:45.194247 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6a0fef12-1e9a-43c2-a1f5-f7feae4512d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:45.194884 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6a0fef12-1e9a-43c2-a1f5-f7feae4512d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:45.195397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6a0fef12-1e9a-43c2-a1f5-f7feae4512d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:45.196278 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6a0fef12-1e9a-43c2-a1f5-f7feae4512d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:45.196952 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6a0fef12-1e9a-43c2-a1f5-f7feae4512d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:45.197466 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6a0fef12-1e9a-43c2-a1f5-f7feae4512d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:45.356914 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6a0fef12-1e9a-43c2-a1f5-f7feae4512d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:45.365162 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6a0fef12-1e9a-43c2-a1f5-f7feae4512d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.183386 Aug 24 09:01:45.365742 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 365/713] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:45 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:45.538705 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2c64326e-de55-428e-ad86-9f0ccaa29f42 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:45.540157 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2c64326e-de55-428e-ad86-9f0ccaa29f42 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:45.551658 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c64326e-de55-428e-ad86-9f0ccaa29f42 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:45.552719 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c64326e-de55-428e-ad86-9f0ccaa29f42 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:45.553585 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c64326e-de55-428e-ad86-9f0ccaa29f42 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:45.555550 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c64326e-de55-428e-ad86-9f0ccaa29f42 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:45.556470 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c64326e-de55-428e-ad86-9f0ccaa29f42 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:45.557370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c64326e-de55-428e-ad86-9f0ccaa29f42 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:45.566845 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:45.753748 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2c64326e-de55-428e-ad86-9f0ccaa29f42 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:45.770893 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2c64326e-de55-428e-ad86-9f0ccaa29f42 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:45.775084 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2c64326e-de55-428e-ad86-9f0ccaa29f42 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:45.777614 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2c64326e-de55-428e-ad86-9f0ccaa29f42 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.245242 Aug 24 09:01:45.778662 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 349/714] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:45 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:46.396869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9c346a8e-87e9-4507-b4d2-541845b55400 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:46.397464 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9c346a8e-87e9-4507-b4d2-541845b55400 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:46.404703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c346a8e-87e9-4507-b4d2-541845b55400 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:46.405191 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c346a8e-87e9-4507-b4d2-541845b55400 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:46.405883 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c346a8e-87e9-4507-b4d2-541845b55400 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:46.406575 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c346a8e-87e9-4507-b4d2-541845b55400 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:46.407058 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c346a8e-87e9-4507-b4d2-541845b55400 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:46.407482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c346a8e-87e9-4507-b4d2-541845b55400 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:46.534196 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9c346a8e-87e9-4507-b4d2-541845b55400 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:46.542188 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9c346a8e-87e9-4507-b4d2-541845b55400 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.149093 Aug 24 09:01:46.542844 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 366/715] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:46 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:46.803263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fa298a5c-4fbe-4202-be1b-b6ac81dca946 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:46.803860 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-fa298a5c-4fbe-4202-be1b-b6ac81dca946 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:46.810855 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa298a5c-4fbe-4202-be1b-b6ac81dca946 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:46.811325 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa298a5c-4fbe-4202-be1b-b6ac81dca946 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:46.811749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa298a5c-4fbe-4202-be1b-b6ac81dca946 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:46.812427 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa298a5c-4fbe-4202-be1b-b6ac81dca946 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:46.812906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa298a5c-4fbe-4202-be1b-b6ac81dca946 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:46.813316 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa298a5c-4fbe-4202-be1b-b6ac81dca946 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:47.219773 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fa298a5c-4fbe-4202-be1b-b6ac81dca946 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:47.229109 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fa298a5c-4fbe-4202-be1b-b6ac81dca946 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:47.230604 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fa298a5c-4fbe-4202-be1b-b6ac81dca946 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:47.231757 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fa298a5c-4fbe-4202-be1b-b6ac81dca946 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.432658 Aug 24 09:01:47.232303 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 350/716] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:46 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:47.563332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-07cb0e09-57c9-4bc8-bb6f-2cc780d95d90 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:47.563939 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-07cb0e09-57c9-4bc8-bb6f-2cc780d95d90 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:47.570445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-07cb0e09-57c9-4bc8-bb6f-2cc780d95d90 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:47.571570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-07cb0e09-57c9-4bc8-bb6f-2cc780d95d90 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:47.571995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-07cb0e09-57c9-4bc8-bb6f-2cc780d95d90 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:47.572711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-07cb0e09-57c9-4bc8-bb6f-2cc780d95d90 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:47.573156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-07cb0e09-57c9-4bc8-bb6f-2cc780d95d90 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:47.573570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-07cb0e09-57c9-4bc8-bb6f-2cc780d95d90 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:47.710485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-07cb0e09-57c9-4bc8-bb6f-2cc780d95d90 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:47.718957 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-07cb0e09-57c9-4bc8-bb6f-2cc780d95d90 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.159368 Aug 24 09:01:47.719618 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 367/717] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:47 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:48.255656 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e25bc06b-8898-40fc-a39b-6d24d0a2ea1a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:48.256321 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e25bc06b-8898-40fc-a39b-6d24d0a2ea1a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:48.274617 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e25bc06b-8898-40fc-a39b-6d24d0a2ea1a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:48.275485 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e25bc06b-8898-40fc-a39b-6d24d0a2ea1a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:48.275858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e25bc06b-8898-40fc-a39b-6d24d0a2ea1a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:48.276663 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e25bc06b-8898-40fc-a39b-6d24d0a2ea1a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:48.277119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e25bc06b-8898-40fc-a39b-6d24d0a2ea1a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:48.279208 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e25bc06b-8898-40fc-a39b-6d24d0a2ea1a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:48.434073 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e25bc06b-8898-40fc-a39b-6d24d0a2ea1a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:48.445598 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e25bc06b-8898-40fc-a39b-6d24d0a2ea1a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:48.447019 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e25bc06b-8898-40fc-a39b-6d24d0a2ea1a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:48.453518 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e25bc06b-8898-40fc-a39b-6d24d0a2ea1a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.196733 Aug 24 09:01:48.453518 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 351/718] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:48 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:48.790006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7c3c8915-f9f6-48d2-b389-19386aa5fc34 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:48.790006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7c3c8915-f9f6-48d2-b389-19386aa5fc34 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:48.790006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7c3c8915-f9f6-48d2-b389-19386aa5fc34 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:48.790006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7c3c8915-f9f6-48d2-b389-19386aa5fc34 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:48.790946 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7c3c8915-f9f6-48d2-b389-19386aa5fc34 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:48.790946 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7c3c8915-f9f6-48d2-b389-19386aa5fc34 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:48.790946 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7c3c8915-f9f6-48d2-b389-19386aa5fc34 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:48.790946 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7c3c8915-f9f6-48d2-b389-19386aa5fc34 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:48.911386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7c3c8915-f9f6-48d2-b389-19386aa5fc34 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:48.911386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7c3c8915-f9f6-48d2-b389-19386aa5fc34 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.160051 Aug 24 09:01:48.911386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 368/719] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:48 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:49.476214 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d087bfb4-6082-4435-93b6-127bb35ac812 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:49.477844 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d087bfb4-6082-4435-93b6-127bb35ac812 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:49.486666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d087bfb4-6082-4435-93b6-127bb35ac812 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:49.487143 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d087bfb4-6082-4435-93b6-127bb35ac812 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:49.487572 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d087bfb4-6082-4435-93b6-127bb35ac812 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:49.488300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d087bfb4-6082-4435-93b6-127bb35ac812 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:49.488783 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d087bfb4-6082-4435-93b6-127bb35ac812 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:49.489194 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d087bfb4-6082-4435-93b6-127bb35ac812 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:49.642176 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d087bfb4-6082-4435-93b6-127bb35ac812 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:49.651706 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d087bfb4-6082-4435-93b6-127bb35ac812 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:49.653271 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d087bfb4-6082-4435-93b6-127bb35ac812 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:49.654403 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d087bfb4-6082-4435-93b6-127bb35ac812 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.185032 Aug 24 09:01:49.654962 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 352/720] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:49 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:49.931890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-76bfdc71-22dd-4190-a531-52d266f2f660 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:49.933211 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-76bfdc71-22dd-4190-a531-52d266f2f660 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:49.950140 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-76bfdc71-22dd-4190-a531-52d266f2f660 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:49.950637 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-76bfdc71-22dd-4190-a531-52d266f2f660 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:49.951071 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-76bfdc71-22dd-4190-a531-52d266f2f660 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:49.952016 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-76bfdc71-22dd-4190-a531-52d266f2f660 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:49.952482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-76bfdc71-22dd-4190-a531-52d266f2f660 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:49.952930 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-76bfdc71-22dd-4190-a531-52d266f2f660 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:50.085088 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-76bfdc71-22dd-4190-a531-52d266f2f660 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:50.093138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-76bfdc71-22dd-4190-a531-52d266f2f660 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.166227 Aug 24 09:01:50.093722 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 369/721] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:49 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:50.679319 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4d4249f2-9bab-4cb3-bc6a-3a7a5cead780 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:50.680489 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4d4249f2-9bab-4cb3-bc6a-3a7a5cead780 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:50.682557 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=46 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:50.688015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4d4249f2-9bab-4cb3-bc6a-3a7a5cead780 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:50.688503 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4d4249f2-9bab-4cb3-bc6a-3a7a5cead780 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:50.688977 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4d4249f2-9bab-4cb3-bc6a-3a7a5cead780 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:50.689694 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4d4249f2-9bab-4cb3-bc6a-3a7a5cead780 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:50.690143 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4d4249f2-9bab-4cb3-bc6a-3a7a5cead780 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:50.692241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4d4249f2-9bab-4cb3-bc6a-3a7a5cead780 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:50.863383 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4d4249f2-9bab-4cb3-bc6a-3a7a5cead780 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:50.880643 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4d4249f2-9bab-4cb3-bc6a-3a7a5cead780 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:50.884310 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4d4249f2-9bab-4cb3-bc6a-3a7a5cead780 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:50.886689 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4d4249f2-9bab-4cb3-bc6a-3a7a5cead780 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.211699 Aug 24 09:01:50.892022 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 353/722] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:50 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:51.115202 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b86db4e0-5bf7-4966-b0a0-392cd3a862ea tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:51.115913 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b86db4e0-5bf7-4966-b0a0-392cd3a862ea tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:51.124332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b86db4e0-5bf7-4966-b0a0-392cd3a862ea tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:51.124915 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b86db4e0-5bf7-4966-b0a0-392cd3a862ea tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:51.125381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b86db4e0-5bf7-4966-b0a0-392cd3a862ea tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:51.126159 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b86db4e0-5bf7-4966-b0a0-392cd3a862ea tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:51.126645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b86db4e0-5bf7-4966-b0a0-392cd3a862ea tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:51.127122 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b86db4e0-5bf7-4966-b0a0-392cd3a862ea tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:51.292935 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b86db4e0-5bf7-4966-b0a0-392cd3a862ea tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:51.301060 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b86db4e0-5bf7-4966-b0a0-392cd3a862ea tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.189882 Aug 24 09:01:51.301994 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 370/723] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:51 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:51.922595 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b351686b-c5f3-4a14-94e1-daf5141ef8df tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:51.923254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b351686b-c5f3-4a14-94e1-daf5141ef8df tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:51.930081 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b351686b-c5f3-4a14-94e1-daf5141ef8df tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:51.930559 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b351686b-c5f3-4a14-94e1-daf5141ef8df tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:51.930993 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b351686b-c5f3-4a14-94e1-daf5141ef8df tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:51.931688 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b351686b-c5f3-4a14-94e1-daf5141ef8df tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:51.932134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b351686b-c5f3-4a14-94e1-daf5141ef8df tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:51.932620 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b351686b-c5f3-4a14-94e1-daf5141ef8df tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:52.078763 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b351686b-c5f3-4a14-94e1-daf5141ef8df tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:52.089497 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b351686b-c5f3-4a14-94e1-daf5141ef8df tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:52.091360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b351686b-c5f3-4a14-94e1-daf5141ef8df tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:52.092696 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b351686b-c5f3-4a14-94e1-daf5141ef8df tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.174024 Aug 24 09:01:52.093934 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 354/724] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:51 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:52.331413 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e746ac3b-da6d-44d7-8d29-5850f5453b1b tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:52.332337 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e746ac3b-da6d-44d7-8d29-5850f5453b1b tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:52.335201 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=63 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:52.343414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e746ac3b-da6d-44d7-8d29-5850f5453b1b tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:52.349679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e746ac3b-da6d-44d7-8d29-5850f5453b1b tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:52.349679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e746ac3b-da6d-44d7-8d29-5850f5453b1b tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:52.349679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e746ac3b-da6d-44d7-8d29-5850f5453b1b tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:52.349679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e746ac3b-da6d-44d7-8d29-5850f5453b1b tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:52.350051 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e746ac3b-da6d-44d7-8d29-5850f5453b1b tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:52.515278 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e746ac3b-da6d-44d7-8d29-5850f5453b1b tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:52.523461 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e746ac3b-da6d-44d7-8d29-5850f5453b1b tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.205154 Aug 24 09:01:52.524661 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 371/725] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:52 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:53.131314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ab8d5861-b62e-4513-b1c3-1d4d6b7d68ba tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:53.131942 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ab8d5861-b62e-4513-b1c3-1d4d6b7d68ba tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:53.138971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab8d5861-b62e-4513-b1c3-1d4d6b7d68ba tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:53.139444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab8d5861-b62e-4513-b1c3-1d4d6b7d68ba tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:53.139872 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab8d5861-b62e-4513-b1c3-1d4d6b7d68ba tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:53.140564 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab8d5861-b62e-4513-b1c3-1d4d6b7d68ba tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:53.141241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab8d5861-b62e-4513-b1c3-1d4d6b7d68ba tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:53.141658 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab8d5861-b62e-4513-b1c3-1d4d6b7d68ba tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:53.275939 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ab8d5861-b62e-4513-b1c3-1d4d6b7d68ba tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:53.285072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ab8d5861-b62e-4513-b1c3-1d4d6b7d68ba tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:53.286599 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ab8d5861-b62e-4513-b1c3-1d4d6b7d68ba tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:53.287747 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ab8d5861-b62e-4513-b1c3-1d4d6b7d68ba tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.160271 Aug 24 09:01:53.288305 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 355/726] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:53 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:53.546597 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d892974f-1e1b-4578-9142-46ac981eda2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:53.547353 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d892974f-1e1b-4578-9142-46ac981eda2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:53.554295 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d892974f-1e1b-4578-9142-46ac981eda2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:53.554772 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d892974f-1e1b-4578-9142-46ac981eda2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:53.555283 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d892974f-1e1b-4578-9142-46ac981eda2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:53.556008 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d892974f-1e1b-4578-9142-46ac981eda2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:53.556458 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d892974f-1e1b-4578-9142-46ac981eda2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:53.556903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d892974f-1e1b-4578-9142-46ac981eda2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:53.688173 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d892974f-1e1b-4578-9142-46ac981eda2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:53.695676 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d892974f-1e1b-4578-9142-46ac981eda2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.153356 Aug 24 09:01:53.696235 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 372/727] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:53 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:54.312087 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-738962d4-7367-472a-9ea5-73c1ea025f41 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:54.312852 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-738962d4-7367-472a-9ea5-73c1ea025f41 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:54.320345 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-738962d4-7367-472a-9ea5-73c1ea025f41 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:54.321495 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-738962d4-7367-472a-9ea5-73c1ea025f41 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:54.322060 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-738962d4-7367-472a-9ea5-73c1ea025f41 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:54.322631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-738962d4-7367-472a-9ea5-73c1ea025f41 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:54.323200 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-738962d4-7367-472a-9ea5-73c1ea025f41 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:54.323544 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-738962d4-7367-472a-9ea5-73c1ea025f41 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:54.481482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-738962d4-7367-472a-9ea5-73c1ea025f41 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:54.494082 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-738962d4-7367-472a-9ea5-73c1ea025f41 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:54.495387 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-738962d4-7367-472a-9ea5-73c1ea025f41 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:54.496586 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-738962d4-7367-472a-9ea5-73c1ea025f41 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.188563 Aug 24 09:01:54.497149 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 356/728] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:54 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:54.778663 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b274ee7b-3e1a-4ced-b8ad-2de07c64433f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:54.779250 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b274ee7b-3e1a-4ced-b8ad-2de07c64433f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:54.785962 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b274ee7b-3e1a-4ced-b8ad-2de07c64433f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:54.786448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b274ee7b-3e1a-4ced-b8ad-2de07c64433f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:54.786878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b274ee7b-3e1a-4ced-b8ad-2de07c64433f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:54.787582 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b274ee7b-3e1a-4ced-b8ad-2de07c64433f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:54.788024 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b274ee7b-3e1a-4ced-b8ad-2de07c64433f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:54.788449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b274ee7b-3e1a-4ced-b8ad-2de07c64433f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:54.934716 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b274ee7b-3e1a-4ced-b8ad-2de07c64433f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:54.943974 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b274ee7b-3e1a-4ced-b8ad-2de07c64433f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.169465 Aug 24 09:01:54.944618 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 373/729] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:54 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:55.520617 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6157457e-9a9a-43dd-843f-252ddf496056 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:55.521352 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6157457e-9a9a-43dd-843f-252ddf496056 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:55.528211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6157457e-9a9a-43dd-843f-252ddf496056 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:55.528834 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6157457e-9a9a-43dd-843f-252ddf496056 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:55.529179 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6157457e-9a9a-43dd-843f-252ddf496056 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:55.530948 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6157457e-9a9a-43dd-843f-252ddf496056 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:55.530948 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6157457e-9a9a-43dd-843f-252ddf496056 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:55.531200 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6157457e-9a9a-43dd-843f-252ddf496056 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:55.674414 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6157457e-9a9a-43dd-843f-252ddf496056 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:55.686273 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6157457e-9a9a-43dd-843f-252ddf496056 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:55.687856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6157457e-9a9a-43dd-843f-252ddf496056 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:55.689073 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6157457e-9a9a-43dd-843f-252ddf496056 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.172518 Aug 24 09:01:55.689631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 357/730] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:55 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:55.972960 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e5c83a88-77dc-4c93-923f-d7ffae154345 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:55.972960 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e5c83a88-77dc-4c93-923f-d7ffae154345 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:55.972960 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e5c83a88-77dc-4c93-923f-d7ffae154345 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:55.973747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e5c83a88-77dc-4c93-923f-d7ffae154345 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:55.973848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e5c83a88-77dc-4c93-923f-d7ffae154345 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:55.974505 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e5c83a88-77dc-4c93-923f-d7ffae154345 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:55.975084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e5c83a88-77dc-4c93-923f-d7ffae154345 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:55.975522 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e5c83a88-77dc-4c93-923f-d7ffae154345 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:56.117544 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e5c83a88-77dc-4c93-923f-d7ffae154345 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:56.126011 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e5c83a88-77dc-4c93-923f-d7ffae154345 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.164689 Aug 24 09:01:56.126770 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 374/731] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:55 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:56.712592 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-de949617-8489-4245-92af-cb634d774b43 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:56.713306 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-de949617-8489-4245-92af-cb634d774b43 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:56.719727 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de949617-8489-4245-92af-cb634d774b43 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:56.720204 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de949617-8489-4245-92af-cb634d774b43 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:56.720661 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de949617-8489-4245-92af-cb634d774b43 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:56.721353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de949617-8489-4245-92af-cb634d774b43 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:56.721805 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de949617-8489-4245-92af-cb634d774b43 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:56.722223 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de949617-8489-4245-92af-cb634d774b43 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:56.862151 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-de949617-8489-4245-92af-cb634d774b43 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:56.871006 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-de949617-8489-4245-92af-cb634d774b43 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:56.872481 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-de949617-8489-4245-92af-cb634d774b43 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:56.873648 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-de949617-8489-4245-92af-cb634d774b43 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.165491 Aug 24 09:01:56.874202 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 358/732] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:56 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:57.150048 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-285ce60d-78d5-4bfa-8f66-37f06fe8726f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:57.150610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-285ce60d-78d5-4bfa-8f66-37f06fe8726f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:57.157307 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-285ce60d-78d5-4bfa-8f66-37f06fe8726f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:57.157812 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-285ce60d-78d5-4bfa-8f66-37f06fe8726f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:57.158241 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-285ce60d-78d5-4bfa-8f66-37f06fe8726f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:57.158917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-285ce60d-78d5-4bfa-8f66-37f06fe8726f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:57.159362 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-285ce60d-78d5-4bfa-8f66-37f06fe8726f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:57.159780 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-285ce60d-78d5-4bfa-8f66-37f06fe8726f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:57.286499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-285ce60d-78d5-4bfa-8f66-37f06fe8726f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:57.294641 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-285ce60d-78d5-4bfa-8f66-37f06fe8726f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.149098 Aug 24 09:01:57.295190 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 375/733] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:57 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:57.898156 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e7a19802-9642-42eb-ad5a-2806db465f40 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:57.898976 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e7a19802-9642-42eb-ad5a-2806db465f40 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:57.907064 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e7a19802-9642-42eb-ad5a-2806db465f40 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:57.907546 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e7a19802-9642-42eb-ad5a-2806db465f40 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:57.907983 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e7a19802-9642-42eb-ad5a-2806db465f40 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:57.908735 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e7a19802-9642-42eb-ad5a-2806db465f40 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:57.909209 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e7a19802-9642-42eb-ad5a-2806db465f40 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:57.909632 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e7a19802-9642-42eb-ad5a-2806db465f40 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:58.089656 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e7a19802-9642-42eb-ad5a-2806db465f40 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:58.098842 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e7a19802-9642-42eb-ad5a-2806db465f40 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:58.100590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e7a19802-9642-42eb-ad5a-2806db465f40 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:58.101997 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e7a19802-9642-42eb-ad5a-2806db465f40 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.208224 Aug 24 09:01:58.103183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 359/734] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:57 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:58.315233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3962cc58-a0a0-4881-a30e-83042c18e259 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:58.315847 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3962cc58-a0a0-4881-a30e-83042c18e259 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:58.322688 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3962cc58-a0a0-4881-a30e-83042c18e259 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:58.323190 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3962cc58-a0a0-4881-a30e-83042c18e259 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:58.323725 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3962cc58-a0a0-4881-a30e-83042c18e259 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:58.324496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3962cc58-a0a0-4881-a30e-83042c18e259 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:58.325013 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3962cc58-a0a0-4881-a30e-83042c18e259 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:58.325448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3962cc58-a0a0-4881-a30e-83042c18e259 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:58.473486 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3962cc58-a0a0-4881-a30e-83042c18e259 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:58.491172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3962cc58-a0a0-4881-a30e-83042c18e259 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.179845 Aug 24 09:01:58.496392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 376/735] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:58 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:59.130660 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1e09f154-924b-41dd-89fa-b5255e0236a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:59.131350 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1e09f154-924b-41dd-89fa-b5255e0236a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:59.138541 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1e09f154-924b-41dd-89fa-b5255e0236a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:59.139021 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1e09f154-924b-41dd-89fa-b5255e0236a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:59.139445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1e09f154-924b-41dd-89fa-b5255e0236a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:59.140149 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1e09f154-924b-41dd-89fa-b5255e0236a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:59.140619 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1e09f154-924b-41dd-89fa-b5255e0236a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:59.141037 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1e09f154-924b-41dd-89fa-b5255e0236a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:59.325412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1e09f154-924b-41dd-89fa-b5255e0236a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:59.334743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1e09f154-924b-41dd-89fa-b5255e0236a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:59.336979 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1e09f154-924b-41dd-89fa-b5255e0236a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:59.338595 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1e09f154-924b-41dd-89fa-b5255e0236a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.211683 Aug 24 09:01:59.339383 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 360/736] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:59 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:59.517770 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-bdc97121-5802-4732-b4fb-15828ef5aded tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:59.518591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-bdc97121-5802-4732-b4fb-15828ef5aded tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:59.525994 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bdc97121-5802-4732-b4fb-15828ef5aded tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:59.526482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bdc97121-5802-4732-b4fb-15828ef5aded tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:59.526950 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bdc97121-5802-4732-b4fb-15828ef5aded tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:59.527760 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bdc97121-5802-4732-b4fb-15828ef5aded tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:59.528156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bdc97121-5802-4732-b4fb-15828ef5aded tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:59.528583 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bdc97121-5802-4732-b4fb-15828ef5aded tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:59.703452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-bdc97121-5802-4732-b4fb-15828ef5aded tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:59.712754 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-bdc97121-5802-4732-b4fb-15828ef5aded tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.199147 Aug 24 09:01:59.713342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 377/737] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:59 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:00.364206 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-bec390af-461c-44c3-a1f5-05d47f4a98fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:00.364855 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-bec390af-461c-44c3-a1f5-05d47f4a98fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:00.371773 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bec390af-461c-44c3-a1f5-05d47f4a98fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:00.372255 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bec390af-461c-44c3-a1f5-05d47f4a98fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:00.372736 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bec390af-461c-44c3-a1f5-05d47f4a98fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:00.373437 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bec390af-461c-44c3-a1f5-05d47f4a98fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:00.373886 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bec390af-461c-44c3-a1f5-05d47f4a98fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:00.374305 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bec390af-461c-44c3-a1f5-05d47f4a98fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:00.520994 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-bec390af-461c-44c3-a1f5-05d47f4a98fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:00.531178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-bec390af-461c-44c3-a1f5-05d47f4a98fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:00.532709 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-bec390af-461c-44c3-a1f5-05d47f4a98fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:00.533893 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-bec390af-461c-44c3-a1f5-05d47f4a98fb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.173640 Aug 24 09:02:00.534448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 361/738] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:00 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:00.732710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5dd978ce-22f9-47de-b26f-6c6cf636d9a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:00.733341 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5dd978ce-22f9-47de-b26f-6c6cf636d9a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:00.740046 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5dd978ce-22f9-47de-b26f-6c6cf636d9a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:00.740531 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5dd978ce-22f9-47de-b26f-6c6cf636d9a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:00.740981 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5dd978ce-22f9-47de-b26f-6c6cf636d9a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:00.741675 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5dd978ce-22f9-47de-b26f-6c6cf636d9a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:00.742116 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5dd978ce-22f9-47de-b26f-6c6cf636d9a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:00.742529 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5dd978ce-22f9-47de-b26f-6c6cf636d9a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:00.882710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5dd978ce-22f9-47de-b26f-6c6cf636d9a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:00.891265 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5dd978ce-22f9-47de-b26f-6c6cf636d9a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.162389 Aug 24 09:02:00.891840 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 378/739] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:00 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:01.559340 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a78fd44d-e762-48f5-8101-4c98d8a50d6c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:01.559968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a78fd44d-e762-48f5-8101-4c98d8a50d6c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:01.566544 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a78fd44d-e762-48f5-8101-4c98d8a50d6c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:01.567021 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a78fd44d-e762-48f5-8101-4c98d8a50d6c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:01.567444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a78fd44d-e762-48f5-8101-4c98d8a50d6c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:01.569458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a78fd44d-e762-48f5-8101-4c98d8a50d6c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:01.569458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a78fd44d-e762-48f5-8101-4c98d8a50d6c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:01.569458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a78fd44d-e762-48f5-8101-4c98d8a50d6c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:01.722324 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a78fd44d-e762-48f5-8101-4c98d8a50d6c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:01.730449 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a78fd44d-e762-48f5-8101-4c98d8a50d6c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:01.731996 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a78fd44d-e762-48f5-8101-4c98d8a50d6c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:01.733238 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a78fd44d-e762-48f5-8101-4c98d8a50d6c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.177761 Aug 24 09:02:01.733801 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 362/740] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:01 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:01.912732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-eb354d6f-1f9a-4bb2-a119-7872f51e28f7 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:01.913432 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-eb354d6f-1f9a-4bb2-a119-7872f51e28f7 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:01.920771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eb354d6f-1f9a-4bb2-a119-7872f51e28f7 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:01.921256 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eb354d6f-1f9a-4bb2-a119-7872f51e28f7 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:01.921688 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eb354d6f-1f9a-4bb2-a119-7872f51e28f7 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:01.922400 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eb354d6f-1f9a-4bb2-a119-7872f51e28f7 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:01.922847 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eb354d6f-1f9a-4bb2-a119-7872f51e28f7 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:01.923318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eb354d6f-1f9a-4bb2-a119-7872f51e28f7 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:02.060174 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-eb354d6f-1f9a-4bb2-a119-7872f51e28f7 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:02.068070 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-eb354d6f-1f9a-4bb2-a119-7872f51e28f7 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.159298 Aug 24 09:02:02.068603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 379/741] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:01 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:02.760933 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ad5fc051-e3aa-4fca-bbdb-bbb7a8b71a64 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:02.762161 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ad5fc051-e3aa-4fca-bbdb-bbb7a8b71a64 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:02.774091 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad5fc051-e3aa-4fca-bbdb-bbb7a8b71a64 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:02.774951 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad5fc051-e3aa-4fca-bbdb-bbb7a8b71a64 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:02.775746 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad5fc051-e3aa-4fca-bbdb-bbb7a8b71a64 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:02.777196 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad5fc051-e3aa-4fca-bbdb-bbb7a8b71a64 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:02.778041 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad5fc051-e3aa-4fca-bbdb-bbb7a8b71a64 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:02.778825 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ad5fc051-e3aa-4fca-bbdb-bbb7a8b71a64 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:02.926449 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ad5fc051-e3aa-4fca-bbdb-bbb7a8b71a64 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:02.935871 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ad5fc051-e3aa-4fca-bbdb-bbb7a8b71a64 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:02.937437 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ad5fc051-e3aa-4fca-bbdb-bbb7a8b71a64 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:02.938586 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ad5fc051-e3aa-4fca-bbdb-bbb7a8b71a64 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.184864 Aug 24 09:02:02.939133 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 363/742] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:02 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:03.090199 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6320d27d-e33b-48be-a330-572e13701f9c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:03.090712 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6320d27d-e33b-48be-a330-572e13701f9c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:03.097156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6320d27d-e33b-48be-a330-572e13701f9c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:03.097629 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6320d27d-e33b-48be-a330-572e13701f9c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:03.098055 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6320d27d-e33b-48be-a330-572e13701f9c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:03.098734 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6320d27d-e33b-48be-a330-572e13701f9c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:03.099180 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6320d27d-e33b-48be-a330-572e13701f9c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:03.099593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6320d27d-e33b-48be-a330-572e13701f9c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:03.229846 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6320d27d-e33b-48be-a330-572e13701f9c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:03.237854 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6320d27d-e33b-48be-a330-572e13701f9c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.152226 Aug 24 09:02:03.238427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 380/743] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:03 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:03.962762 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5040784e-0e31-4afc-af0a-3d54bc1f8705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:03.963449 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5040784e-0e31-4afc-af0a-3d54bc1f8705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:03.970064 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5040784e-0e31-4afc-af0a-3d54bc1f8705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:03.970542 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5040784e-0e31-4afc-af0a-3d54bc1f8705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:03.970970 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5040784e-0e31-4afc-af0a-3d54bc1f8705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:03.971658 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5040784e-0e31-4afc-af0a-3d54bc1f8705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:03.972104 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5040784e-0e31-4afc-af0a-3d54bc1f8705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:03.972559 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5040784e-0e31-4afc-af0a-3d54bc1f8705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:04.122449 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5040784e-0e31-4afc-af0a-3d54bc1f8705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:04.131134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5040784e-0e31-4afc-af0a-3d54bc1f8705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:04.132714 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5040784e-0e31-4afc-af0a-3d54bc1f8705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:04.133816 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5040784e-0e31-4afc-af0a-3d54bc1f8705 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.175411 Aug 24 09:02:04.134599 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 364/744] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:03 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:04.259184 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b148767b-1801-48cc-ae99-e8ae0e5e2314 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:04.259874 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b148767b-1801-48cc-ae99-e8ae0e5e2314 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:04.266466 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b148767b-1801-48cc-ae99-e8ae0e5e2314 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:04.266937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b148767b-1801-48cc-ae99-e8ae0e5e2314 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:04.267367 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b148767b-1801-48cc-ae99-e8ae0e5e2314 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:04.268115 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b148767b-1801-48cc-ae99-e8ae0e5e2314 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:04.268621 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b148767b-1801-48cc-ae99-e8ae0e5e2314 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:04.269042 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b148767b-1801-48cc-ae99-e8ae0e5e2314 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:04.284603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:04.404246 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b148767b-1801-48cc-ae99-e8ae0e5e2314 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:04.414312 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b148767b-1801-48cc-ae99-e8ae0e5e2314 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.159191 Aug 24 09:02:04.415178 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 381/745] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:04 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:05.157743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-541822c1-72a7-411c-98bb-3d680e50bd18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:05.158337 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-541822c1-72a7-411c-98bb-3d680e50bd18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:05.165492 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-541822c1-72a7-411c-98bb-3d680e50bd18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.165977 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-541822c1-72a7-411c-98bb-3d680e50bd18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.166421 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-541822c1-72a7-411c-98bb-3d680e50bd18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.167111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-541822c1-72a7-411c-98bb-3d680e50bd18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.167567 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-541822c1-72a7-411c-98bb-3d680e50bd18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.167980 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-541822c1-72a7-411c-98bb-3d680e50bd18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.299075 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-541822c1-72a7-411c-98bb-3d680e50bd18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:05.301258 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:05.309175 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-541822c1-72a7-411c-98bb-3d680e50bd18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:05.310640 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-541822c1-72a7-411c-98bb-3d680e50bd18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:05.314165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-541822c1-72a7-411c-98bb-3d680e50bd18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.158292 Aug 24 09:02:05.314165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 365/746] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:05 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:05.436851 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c8233356-3d6c-4eeb-9817-dc93ebcfe364 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:05.437455 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c8233356-3d6c-4eeb-9817-dc93ebcfe364 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:05.443874 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c8233356-3d6c-4eeb-9817-dc93ebcfe364 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.444358 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c8233356-3d6c-4eeb-9817-dc93ebcfe364 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.444831 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c8233356-3d6c-4eeb-9817-dc93ebcfe364 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.445609 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c8233356-3d6c-4eeb-9817-dc93ebcfe364 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.446064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c8233356-3d6c-4eeb-9817-dc93ebcfe364 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.446490 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c8233356-3d6c-4eeb-9817-dc93ebcfe364 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.584268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c8233356-3d6c-4eeb-9817-dc93ebcfe364 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:05.592347 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c8233356-3d6c-4eeb-9817-dc93ebcfe364 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.159584 Aug 24 09:02:05.592955 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 382/747] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:05 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:06.335144 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-48d1ab1d-e09f-4456-a845-8a20d744fece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:06.335742 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-48d1ab1d-e09f-4456-a845-8a20d744fece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:06.342301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-48d1ab1d-e09f-4456-a845-8a20d744fece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:06.342775 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-48d1ab1d-e09f-4456-a845-8a20d744fece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:06.343204 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-48d1ab1d-e09f-4456-a845-8a20d744fece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:06.343880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-48d1ab1d-e09f-4456-a845-8a20d744fece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:06.344317 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-48d1ab1d-e09f-4456-a845-8a20d744fece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:06.344757 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-48d1ab1d-e09f-4456-a845-8a20d744fece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:06.483763 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-48d1ab1d-e09f-4456-a845-8a20d744fece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:06.493126 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-48d1ab1d-e09f-4456-a845-8a20d744fece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:06.494593 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-48d1ab1d-e09f-4456-a845-8a20d744fece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:06.495741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-48d1ab1d-e09f-4456-a845-8a20d744fece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.164844 Aug 24 09:02:06.496297 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 366/748] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:06 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:06.613876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2e29126f-bfc3-4eb1-bde5-0a42f63dff14 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:06.615446 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2e29126f-bfc3-4eb1-bde5-0a42f63dff14 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:06.620821 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2e29126f-bfc3-4eb1-bde5-0a42f63dff14 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:06.621301 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2e29126f-bfc3-4eb1-bde5-0a42f63dff14 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:06.621728 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2e29126f-bfc3-4eb1-bde5-0a42f63dff14 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:06.622458 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2e29126f-bfc3-4eb1-bde5-0a42f63dff14 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:06.622905 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2e29126f-bfc3-4eb1-bde5-0a42f63dff14 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:06.623319 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2e29126f-bfc3-4eb1-bde5-0a42f63dff14 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:06.753629 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2e29126f-bfc3-4eb1-bde5-0a42f63dff14 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:06.762113 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2e29126f-bfc3-4eb1-bde5-0a42f63dff14 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.152170 Aug 24 09:02:06.762699 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 383/749] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:06 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:07.519444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c74f79d0-917b-49c8-8bab-87d4b60cba15 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:07.520133 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c74f79d0-917b-49c8-8bab-87d4b60cba15 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:07.527064 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c74f79d0-917b-49c8-8bab-87d4b60cba15 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:07.527553 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c74f79d0-917b-49c8-8bab-87d4b60cba15 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:07.527986 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c74f79d0-917b-49c8-8bab-87d4b60cba15 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:07.528731 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c74f79d0-917b-49c8-8bab-87d4b60cba15 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:07.529214 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c74f79d0-917b-49c8-8bab-87d4b60cba15 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:07.529664 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c74f79d0-917b-49c8-8bab-87d4b60cba15 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:07.665008 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c74f79d0-917b-49c8-8bab-87d4b60cba15 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:07.673735 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c74f79d0-917b-49c8-8bab-87d4b60cba15 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:07.675237 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c74f79d0-917b-49c8-8bab-87d4b60cba15 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:07.676529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c74f79d0-917b-49c8-8bab-87d4b60cba15 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.161181 Aug 24 09:02:07.677345 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 367/750] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:07 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:02:07.783743 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c14dbd58-4b8f-4a60-b061-e75dbc911080 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:07.785177 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c14dbd58-4b8f-4a60-b061-e75dbc911080 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:07.792582 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c14dbd58-4b8f-4a60-b061-e75dbc911080 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:07.793314 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c14dbd58-4b8f-4a60-b061-e75dbc911080 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:07.793909 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c14dbd58-4b8f-4a60-b061-e75dbc911080 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:07.794799 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c14dbd58-4b8f-4a60-b061-e75dbc911080 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:07.795418 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c14dbd58-4b8f-4a60-b061-e75dbc911080 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:07.796008 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c14dbd58-4b8f-4a60-b061-e75dbc911080 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:07.966501 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c14dbd58-4b8f-4a60-b061-e75dbc911080 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:07.974638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c14dbd58-4b8f-4a60-b061-e75dbc911080 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.194926 Aug 24 09:02:07.975216 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 384/751] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:07 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:08.699991 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4615a89e-4d01-4288-a641-080be550c7d5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:08.700670 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4615a89e-4d01-4288-a641-080be550c7d5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:08.707241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4615a89e-4d01-4288-a641-080be550c7d5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:08.707727 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4615a89e-4d01-4288-a641-080be550c7d5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:08.708164 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4615a89e-4d01-4288-a641-080be550c7d5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:08.708889 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4615a89e-4d01-4288-a641-080be550c7d5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:08.709336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4615a89e-4d01-4288-a641-080be550c7d5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:08.709752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4615a89e-4d01-4288-a641-080be550c7d5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:08.934399 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4615a89e-4d01-4288-a641-080be550c7d5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:08.943103 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4615a89e-4d01-4288-a641-080be550c7d5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:08.944636 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4615a89e-4d01-4288-a641-080be550c7d5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:08.945823 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4615a89e-4d01-4288-a641-080be550c7d5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.250430 Aug 24 09:02:08.946374 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 368/752] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:08 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:08.998967 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2a72872b-f833-4d08-bf51-3d377bfffaab tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:08.999924 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2a72872b-f833-4d08-bf51-3d377bfffaab tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:09.006811 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2a72872b-f833-4d08-bf51-3d377bfffaab tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:09.007280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2a72872b-f833-4d08-bf51-3d377bfffaab tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:09.010985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2a72872b-f833-4d08-bf51-3d377bfffaab tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:09.010985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2a72872b-f833-4d08-bf51-3d377bfffaab tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:09.010985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2a72872b-f833-4d08-bf51-3d377bfffaab tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:09.010985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2a72872b-f833-4d08-bf51-3d377bfffaab tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:09.154161 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2a72872b-f833-4d08-bf51-3d377bfffaab tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:09.162877 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2a72872b-f833-4d08-bf51-3d377bfffaab tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.167638 Aug 24 09:02:09.165197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 385/753] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:08 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:09.613200 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-5ff1fd82-cbd2-43bc-8467-1dab9b31704c req-4d90b6f8-b5d6-49d2-89a0-d14d4a8e28bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc47a1d8-3769-47c2-b88d-3b75b26eddce", "name": "network-vif-plugged", "status": "completed", "tag": "8ded112a-e184-4f96-9bf7-0ce179e1f278"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:09.622881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-5ff1fd82-cbd2-43bc-8467-1dab9b31704c req-4d90b6f8-b5d6-49d2-89a0-d14d4a8e28bb service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:09.623358 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-5ff1fd82-cbd2-43bc-8467-1dab9b31704c req-4d90b6f8-b5d6-49d2-89a0-d14d4a8e28bb service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:09.623786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-5ff1fd82-cbd2-43bc-8467-1dab9b31704c req-4d90b6f8-b5d6-49d2-89a0-d14d4a8e28bb service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:09.636507 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-5ff1fd82-cbd2-43bc-8467-1dab9b31704c req-4d90b6f8-b5d6-49d2-89a0-d14d4a8e28bb service nova] Creating event network-vif-plugged:8ded112a-e184-4f96-9bf7-0ce179e1f278 for instance fc47a1d8-3769-47c2-b88d-3b75b26eddce on hv-cinder-85221 Aug 24 09:02:09.643254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-5ff1fd82-cbd2-43bc-8467-1dab9b31704c req-4d90b6f8-b5d6-49d2-89a0-d14d4a8e28bb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218422 Aug 24 09:02:09.643254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 369/754] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:09.968100 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a18c114a-0b35-406a-b2ca-1fa3f0650b19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:09.968749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a18c114a-0b35-406a-b2ca-1fa3f0650b19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:09.974831 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a18c114a-0b35-406a-b2ca-1fa3f0650b19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:09.975316 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a18c114a-0b35-406a-b2ca-1fa3f0650b19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:09.975745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a18c114a-0b35-406a-b2ca-1fa3f0650b19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:09.976443 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a18c114a-0b35-406a-b2ca-1fa3f0650b19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:09.976920 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a18c114a-0b35-406a-b2ca-1fa3f0650b19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:09.977345 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a18c114a-0b35-406a-b2ca-1fa3f0650b19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:10.110872 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a18c114a-0b35-406a-b2ca-1fa3f0650b19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:10.119941 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a18c114a-0b35-406a-b2ca-1fa3f0650b19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:10.121496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a18c114a-0b35-406a-b2ca-1fa3f0650b19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:10.122657 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a18c114a-0b35-406a-b2ca-1fa3f0650b19 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.158664 Aug 24 09:02:10.123220 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 386/755] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:09 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:10.186086 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-36859c80-e795-441c-bc95-8b269fc601e5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:10.186766 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-36859c80-e795-441c-bc95-8b269fc601e5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:10.193055 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36859c80-e795-441c-bc95-8b269fc601e5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:10.193532 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36859c80-e795-441c-bc95-8b269fc601e5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:10.193971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36859c80-e795-441c-bc95-8b269fc601e5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:10.194646 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36859c80-e795-441c-bc95-8b269fc601e5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:10.195653 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36859c80-e795-441c-bc95-8b269fc601e5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:10.196068 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-36859c80-e795-441c-bc95-8b269fc601e5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:10.330385 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-36859c80-e795-441c-bc95-8b269fc601e5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:10.339466 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-36859c80-e795-441c-bc95-8b269fc601e5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.157979 Aug 24 09:02:10.340050 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 370/756] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:10 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:11.146333 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b21e315f-56ba-423d-9c5f-2ef27ccbee98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:11.146978 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b21e315f-56ba-423d-9c5f-2ef27ccbee98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:11.154354 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b21e315f-56ba-423d-9c5f-2ef27ccbee98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:11.155101 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b21e315f-56ba-423d-9c5f-2ef27ccbee98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:11.155994 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b21e315f-56ba-423d-9c5f-2ef27ccbee98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:11.156898 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b21e315f-56ba-423d-9c5f-2ef27ccbee98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:11.157513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b21e315f-56ba-423d-9c5f-2ef27ccbee98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:11.158101 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b21e315f-56ba-423d-9c5f-2ef27ccbee98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:11.315180 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b21e315f-56ba-423d-9c5f-2ef27ccbee98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:11.326459 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b21e315f-56ba-423d-9c5f-2ef27ccbee98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:11.328044 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b21e315f-56ba-423d-9c5f-2ef27ccbee98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:11.329495 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b21e315f-56ba-423d-9c5f-2ef27ccbee98 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.187031 Aug 24 09:02:11.329920 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 387/757] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:11 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:11.366751 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9736274e-a880-491c-82f3-d74e60dc8d1f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:11.367888 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9736274e-a880-491c-82f3-d74e60dc8d1f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:11.374488 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9736274e-a880-491c-82f3-d74e60dc8d1f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:11.374968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9736274e-a880-491c-82f3-d74e60dc8d1f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:11.375393 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9736274e-a880-491c-82f3-d74e60dc8d1f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:11.376086 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9736274e-a880-491c-82f3-d74e60dc8d1f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:11.376630 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9736274e-a880-491c-82f3-d74e60dc8d1f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:11.376957 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9736274e-a880-491c-82f3-d74e60dc8d1f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:11.518888 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9736274e-a880-491c-82f3-d74e60dc8d1f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:11.528789 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9736274e-a880-491c-82f3-d74e60dc8d1f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.169317 Aug 24 09:02:11.529396 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 371/758] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:11 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:12.353877 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c4042b8b-fe86-4a83-8e10-54d1fa9fb25d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:12.354471 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c4042b8b-fe86-4a83-8e10-54d1fa9fb25d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:12.361173 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c4042b8b-fe86-4a83-8e10-54d1fa9fb25d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:12.361653 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c4042b8b-fe86-4a83-8e10-54d1fa9fb25d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:12.362075 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c4042b8b-fe86-4a83-8e10-54d1fa9fb25d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:12.362764 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c4042b8b-fe86-4a83-8e10-54d1fa9fb25d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:12.363204 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c4042b8b-fe86-4a83-8e10-54d1fa9fb25d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:12.363619 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c4042b8b-fe86-4a83-8e10-54d1fa9fb25d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:12.528652 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c4042b8b-fe86-4a83-8e10-54d1fa9fb25d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:12.537882 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c4042b8b-fe86-4a83-8e10-54d1fa9fb25d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:12.540172 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c4042b8b-fe86-4a83-8e10-54d1fa9fb25d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:12.540607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c4042b8b-fe86-4a83-8e10-54d1fa9fb25d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.191255 Aug 24 09:02:12.541165 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 388/759] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:12 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:12.554953 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6537c203-6c0a-428d-b063-6b4a5dcd97ae tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:12.556140 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6537c203-6c0a-428d-b063-6b4a5dcd97ae tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:12.567862 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6537c203-6c0a-428d-b063-6b4a5dcd97ae tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:12.568804 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6537c203-6c0a-428d-b063-6b4a5dcd97ae tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:12.569587 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6537c203-6c0a-428d-b063-6b4a5dcd97ae tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:12.570999 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6537c203-6c0a-428d-b063-6b4a5dcd97ae tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:12.571521 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6537c203-6c0a-428d-b063-6b4a5dcd97ae tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:12.572146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6537c203-6c0a-428d-b063-6b4a5dcd97ae tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:12.706197 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6537c203-6c0a-428d-b063-6b4a5dcd97ae tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:12.720280 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6537c203-6c0a-428d-b063-6b4a5dcd97ae tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.172922 Aug 24 09:02:12.720911 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 372/760] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:12 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:13.576909 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-61bf055c-f419-4ae5-a6ce-2dcdc0537215 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:13.577530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-61bf055c-f419-4ae5-a6ce-2dcdc0537215 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:13.584324 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61bf055c-f419-4ae5-a6ce-2dcdc0537215 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:13.584850 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61bf055c-f419-4ae5-a6ce-2dcdc0537215 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:13.585279 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61bf055c-f419-4ae5-a6ce-2dcdc0537215 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:13.586469 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61bf055c-f419-4ae5-a6ce-2dcdc0537215 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:13.586918 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61bf055c-f419-4ae5-a6ce-2dcdc0537215 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:13.587334 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61bf055c-f419-4ae5-a6ce-2dcdc0537215 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:13.727593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-61bf055c-f419-4ae5-a6ce-2dcdc0537215 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:13.736996 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-61bf055c-f419-4ae5-a6ce-2dcdc0537215 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:13.738506 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-61bf055c-f419-4ae5-a6ce-2dcdc0537215 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:13.739723 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-61bf055c-f419-4ae5-a6ce-2dcdc0537215 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.166913 Aug 24 09:02:13.740404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 389/761] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:13 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:13.743912 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-966d783b-6e65-4ee1-b3a1-5b23ebd0cd7f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:13.744557 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-966d783b-6e65-4ee1-b3a1-5b23ebd0cd7f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:13.751874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-966d783b-6e65-4ee1-b3a1-5b23ebd0cd7f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:13.752383 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-966d783b-6e65-4ee1-b3a1-5b23ebd0cd7f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:13.752855 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-966d783b-6e65-4ee1-b3a1-5b23ebd0cd7f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:13.753560 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-966d783b-6e65-4ee1-b3a1-5b23ebd0cd7f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:13.754040 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-966d783b-6e65-4ee1-b3a1-5b23ebd0cd7f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:13.754467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-966d783b-6e65-4ee1-b3a1-5b23ebd0cd7f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:13.898983 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-966d783b-6e65-4ee1-b3a1-5b23ebd0cd7f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:13.907639 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-966d783b-6e65-4ee1-b3a1-5b23ebd0cd7f tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1359 microversion: 2.1 time: 0.167818 Aug 24 09:02:13.908210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 373/762] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:13 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:13.930174 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-880dd98a-6958-4909-968f-88e128a98331 req-a5d75171-a4bf-4853-85d4-e759373efabe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abdb5828-315b-4046-9985-95e58a2f24b3", "name": "network-vif-plugged", "status": "completed", "tag": "756cdfb7-826d-4039-9977-c15d62078dd5"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:13.940300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-880dd98a-6958-4909-968f-88e128a98331 req-a5d75171-a4bf-4853-85d4-e759373efabe service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:13.940807 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-880dd98a-6958-4909-968f-88e128a98331 req-a5d75171-a4bf-4853-85d4-e759373efabe service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:13.941241 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-880dd98a-6958-4909-968f-88e128a98331 req-a5d75171-a4bf-4853-85d4-e759373efabe service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:13.952923 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-880dd98a-6958-4909-968f-88e128a98331 req-a5d75171-a4bf-4853-85d4-e759373efabe service nova] Creating event network-vif-plugged:756cdfb7-826d-4039-9977-c15d62078dd5 for instance abdb5828-315b-4046-9985-95e58a2f24b3 on hv-cinder-85221 Aug 24 09:02:13.958235 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-880dd98a-6958-4909-968f-88e128a98331 req-a5d75171-a4bf-4853-85d4-e759373efabe service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031436 Aug 24 09:02:13.958933 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 390/763] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:14.766254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-de5b7282-7d05-4187-bd02-ce0d56b04d71 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:14.766852 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-de5b7282-7d05-4187-bd02-ce0d56b04d71 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:14.773745 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de5b7282-7d05-4187-bd02-ce0d56b04d71 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:14.774234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de5b7282-7d05-4187-bd02-ce0d56b04d71 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:14.774664 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de5b7282-7d05-4187-bd02-ce0d56b04d71 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:14.775376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de5b7282-7d05-4187-bd02-ce0d56b04d71 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:14.775827 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de5b7282-7d05-4187-bd02-ce0d56b04d71 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:14.776249 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de5b7282-7d05-4187-bd02-ce0d56b04d71 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:14.928823 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-de5b7282-7d05-4187-bd02-ce0d56b04d71 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:14.931889 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4da94b52-5377-4e79-a3f9-e7164b5fc84c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:14.931889 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4da94b52-5377-4e79-a3f9-e7164b5fc84c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:14.943127 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4da94b52-5377-4e79-a3f9-e7164b5fc84c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:14.943635 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4da94b52-5377-4e79-a3f9-e7164b5fc84c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:14.944059 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4da94b52-5377-4e79-a3f9-e7164b5fc84c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:14.944598 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-de5b7282-7d05-4187-bd02-ce0d56b04d71 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:14.944794 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4da94b52-5377-4e79-a3f9-e7164b5fc84c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:14.945250 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4da94b52-5377-4e79-a3f9-e7164b5fc84c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:14.945710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4da94b52-5377-4e79-a3f9-e7164b5fc84c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:14.946135 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-de5b7282-7d05-4187-bd02-ce0d56b04d71 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:14.947301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-de5b7282-7d05-4187-bd02-ce0d56b04d71 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.185128 Aug 24 09:02:14.947850 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 374/764] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:14 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:15.099360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4da94b52-5377-4e79-a3f9-e7164b5fc84c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:15.108790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4da94b52-5377-4e79-a3f9-e7164b5fc84c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1548 microversion: 2.1 time: 0.182686 Aug 24 09:02:15.109439 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 391/765] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:14 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1548 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:15.129484 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-102cffb3-5cc9-4a19-b175-0192e37165b9 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:15.130134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-102cffb3-5cc9-4a19-b175-0192e37165b9 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:15.136505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-102cffb3-5cc9-4a19-b175-0192e37165b9 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:15.137056 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-102cffb3-5cc9-4a19-b175-0192e37165b9 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:15.137490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-102cffb3-5cc9-4a19-b175-0192e37165b9 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:15.138273 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-102cffb3-5cc9-4a19-b175-0192e37165b9 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:15.138726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-102cffb3-5cc9-4a19-b175-0192e37165b9 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:15.139186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-102cffb3-5cc9-4a19-b175-0192e37165b9 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:15.278877 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-102cffb3-5cc9-4a19-b175-0192e37165b9 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:15.292973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-102cffb3-5cc9-4a19-b175-0192e37165b9 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1548 microversion: 2.1 time: 0.162048 Aug 24 09:02:15.292973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 375/766] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:15 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:15.308344 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8ba62998-3466-41ff-8645-5b25583682a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:15.313241 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8ba62998-3466-41ff-8645-5b25583682a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:15.314029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8ba62998-3466-41ff-8645-5b25583682a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Searching by: {'deleted': False, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98'} {{(pid=132984) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 09:02:15.320744 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ba62998-3466-41ff-8645-5b25583682a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:15.321215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ba62998-3466-41ff-8645-5b25583682a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:15.321638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ba62998-3466-41ff-8645-5b25583682a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:15.322355 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ba62998-3466-41ff-8645-5b25583682a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:15.322799 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ba62998-3466-41ff-8645-5b25583682a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:15.323205 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ba62998-3466-41ff-8645-5b25583682a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:15.421823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.multi_cell_list [None req-8ba62998-3466-41ff-8645-5b25583682a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 09:02:15.516786 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8ba62998-3466-41ff-8645-5b25583682a1 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212105 Aug 24 09:02:15.517594 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 392/767] 10.222.0.55 () {58 vars in 1125 bytes} [Wed Aug 24 09:02:15 2022] GET /compute/v2.1/servers => generated 343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:15.534521 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b07b47fd-b18f-4940-9239-dc79d123af96 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:15.534521 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b07b47fd-b18f-4940-9239-dc79d123af96 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:15.540706 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b07b47fd-b18f-4940-9239-dc79d123af96 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:15.541754 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b07b47fd-b18f-4940-9239-dc79d123af96 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:15.542654 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b07b47fd-b18f-4940-9239-dc79d123af96 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:15.543484 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b07b47fd-b18f-4940-9239-dc79d123af96 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:15.543904 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b07b47fd-b18f-4940-9239-dc79d123af96 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:15.544358 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b07b47fd-b18f-4940-9239-dc79d123af96 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:15.812236 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b07b47fd-b18f-4940-9239-dc79d123af96 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:15.820335 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b07b47fd-b18f-4940-9239-dc79d123af96 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1548 microversion: 2.1 time: 0.294209 Aug 24 09:02:15.820950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 376/768] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:15 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1548 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:15.971119 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9b9ac52c-f41b-4b0a-b766-f68871442f79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:15.971762 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9b9ac52c-f41b-4b0a-b766-f68871442f79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:15.978981 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9b9ac52c-f41b-4b0a-b766-f68871442f79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:15.979458 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9b9ac52c-f41b-4b0a-b766-f68871442f79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:15.979891 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9b9ac52c-f41b-4b0a-b766-f68871442f79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:15.980636 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9b9ac52c-f41b-4b0a-b766-f68871442f79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:15.981082 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9b9ac52c-f41b-4b0a-b766-f68871442f79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:15.981499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9b9ac52c-f41b-4b0a-b766-f68871442f79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:16.119036 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9b9ac52c-f41b-4b0a-b766-f68871442f79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:16.128740 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9b9ac52c-f41b-4b0a-b766-f68871442f79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:16.130234 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9b9ac52c-f41b-4b0a-b766-f68871442f79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:16.131410 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9b9ac52c-f41b-4b0a-b766-f68871442f79 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.164945 Aug 24 09:02:16.132011 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 393/769] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:15 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:16.795322 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ef4f2f3e-ad35-42cd-90bd-4f95ea6713bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:16.797937 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ef4f2f3e-ad35-42cd-90bd-4f95ea6713bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:16.804968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef4f2f3e-ad35-42cd-90bd-4f95ea6713bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:16.805498 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef4f2f3e-ad35-42cd-90bd-4f95ea6713bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:16.805841 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef4f2f3e-ad35-42cd-90bd-4f95ea6713bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:16.806472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef4f2f3e-ad35-42cd-90bd-4f95ea6713bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:16.806917 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef4f2f3e-ad35-42cd-90bd-4f95ea6713bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:16.807329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef4f2f3e-ad35-42cd-90bd-4f95ea6713bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:16.831708 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-ef4f2f3e-ad35-42cd-90bd-4f95ea6713bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lazy-loading 'flavor' on Instance uuid b2342ef6-1538-4ed8-a880-4592faa068f5 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:02:17.155969 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0f3a1b58-ad91-4856-8419-bd6adc350ee9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:17.156576 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0f3a1b58-ad91-4856-8419-bd6adc350ee9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:17.162776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f3a1b58-ad91-4856-8419-bd6adc350ee9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:17.163272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f3a1b58-ad91-4856-8419-bd6adc350ee9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:17.163692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f3a1b58-ad91-4856-8419-bd6adc350ee9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:17.164380 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f3a1b58-ad91-4856-8419-bd6adc350ee9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:17.164864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f3a1b58-ad91-4856-8419-bd6adc350ee9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:17.165279 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f3a1b58-ad91-4856-8419-bd6adc350ee9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:17.273971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ef4f2f3e-ad35-42cd-90bd-4f95ea6713bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "POST /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/action" status: 200 len: 32 microversion: 2.1 time: 0.482730 Aug 24 09:02:17.275376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 377/770] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 09:02:16 2022] POST /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/action => generated 32 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:02:17.287284 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-dc6866e6-6106-436c-aae6-f02c1071bdbf tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:17.288004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-dc6866e6-6106-436c-aae6-f02c1071bdbf tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:17.295236 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc6866e6-6106-436c-aae6-f02c1071bdbf tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:17.295730 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc6866e6-6106-436c-aae6-f02c1071bdbf tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:17.296380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc6866e6-6106-436c-aae6-f02c1071bdbf tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:17.297414 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc6866e6-6106-436c-aae6-f02c1071bdbf tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:17.297876 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc6866e6-6106-436c-aae6-f02c1071bdbf tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:17.298309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dc6866e6-6106-436c-aae6-f02c1071bdbf tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:17.310053 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0f3a1b58-ad91-4856-8419-bd6adc350ee9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:17.319523 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0f3a1b58-ad91-4856-8419-bd6adc350ee9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:17.321655 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0f3a1b58-ad91-4856-8419-bd6adc350ee9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:17.322858 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0f3a1b58-ad91-4856-8419-bd6adc350ee9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.171248 Aug 24 09:02:17.323440 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 394/771] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:17 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:02:17.431821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-dc6866e6-6106-436c-aae6-f02c1071bdbf tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:17.440997 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-dc6866e6-6106-436c-aae6-f02c1071bdbf tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.158081 Aug 24 09:02:17.441566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 378/772] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:17 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:18.348184 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-93f59878-34c3-4112-824a-9b3db17e82f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:18.349055 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-93f59878-34c3-4112-824a-9b3db17e82f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:18.357547 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-93f59878-34c3-4112-824a-9b3db17e82f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:18.358026 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-93f59878-34c3-4112-824a-9b3db17e82f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:18.358468 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-93f59878-34c3-4112-824a-9b3db17e82f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:18.359162 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-93f59878-34c3-4112-824a-9b3db17e82f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:18.359612 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-93f59878-34c3-4112-824a-9b3db17e82f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:18.360031 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-93f59878-34c3-4112-824a-9b3db17e82f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:18.464403 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9597519b-153a-40d6-8f9a-c6d424e925b7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:18.465542 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9597519b-153a-40d6-8f9a-c6d424e925b7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:18.478168 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9597519b-153a-40d6-8f9a-c6d424e925b7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:18.479188 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9597519b-153a-40d6-8f9a-c6d424e925b7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:18.479939 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9597519b-153a-40d6-8f9a-c6d424e925b7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:18.481236 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9597519b-153a-40d6-8f9a-c6d424e925b7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:18.482064 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9597519b-153a-40d6-8f9a-c6d424e925b7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:18.482846 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9597519b-153a-40d6-8f9a-c6d424e925b7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:18.540140 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-93f59878-34c3-4112-824a-9b3db17e82f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:18.549561 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-93f59878-34c3-4112-824a-9b3db17e82f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:18.551049 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-93f59878-34c3-4112-824a-9b3db17e82f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:18.552213 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-93f59878-34c3-4112-824a-9b3db17e82f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.209277 Aug 24 09:02:18.553099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 395/773] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:18 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:18.650704 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9597519b-153a-40d6-8f9a-c6d424e925b7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:18.659205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9597519b-153a-40d6-8f9a-c6d424e925b7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.200630 Aug 24 09:02:18.659795 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 379/774] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:18 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:19.031739 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ed5b3298-86b0-4635-9548-1b2eea395bca tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90dacc93-ee43-44f2-9884-0f1be951c7e6"}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:19.034159 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ed5b3298-86b0-4635-9548-1b2eea395bca tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:19.040893 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ed5b3298-86b0-4635-9548-1b2eea395bca tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:19.041367 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ed5b3298-86b0-4635-9548-1b2eea395bca tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:19.041795 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ed5b3298-86b0-4635-9548-1b2eea395bca tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:19.042485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ed5b3298-86b0-4635-9548-1b2eea395bca tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:19.042923 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ed5b3298-86b0-4635-9548-1b2eea395bca tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:19.043340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ed5b3298-86b0-4635-9548-1b2eea395bca tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:19.577694 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fcd13bd6-fc1f-438a-90e2-d6b69d59b069 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:19.578389 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-fcd13bd6-fc1f-438a-90e2-d6b69d59b069 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:19.585364 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fcd13bd6-fc1f-438a-90e2-d6b69d59b069 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:19.586446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fcd13bd6-fc1f-438a-90e2-d6b69d59b069 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:19.586876 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fcd13bd6-fc1f-438a-90e2-d6b69d59b069 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:19.587571 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fcd13bd6-fc1f-438a-90e2-d6b69d59b069 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:19.588016 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fcd13bd6-fc1f-438a-90e2-d6b69d59b069 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:19.588461 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fcd13bd6-fc1f-438a-90e2-d6b69d59b069 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:19.734631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fcd13bd6-fc1f-438a-90e2-d6b69d59b069 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:19.749428 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fcd13bd6-fc1f-438a-90e2-d6b69d59b069 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:19.750944 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fcd13bd6-fc1f-438a-90e2-d6b69d59b069 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:19.752130 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fcd13bd6-fc1f-438a-90e2-d6b69d59b069 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.178679 Aug 24 09:02:19.753141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 380/775] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:19 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:02:19.758234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-60eb6242-70ed-4704-86e2-80eba057edeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:19.758848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-60eb6242-70ed-4704-86e2-80eba057edeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:19.765359 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-60eb6242-70ed-4704-86e2-80eba057edeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:19.765841 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-60eb6242-70ed-4704-86e2-80eba057edeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:19.766276 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-60eb6242-70ed-4704-86e2-80eba057edeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:19.766978 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-60eb6242-70ed-4704-86e2-80eba057edeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:19.767430 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-60eb6242-70ed-4704-86e2-80eba057edeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:19.767848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-60eb6242-70ed-4704-86e2-80eba057edeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:19.770944 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:19.920470 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-60eb6242-70ed-4704-86e2-80eba057edeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:19.929929 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-60eb6242-70ed-4704-86e2-80eba057edeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.175682 Aug 24 09:02:19.930512 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 381/776] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:19 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:19.995871 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ed5b3298-86b0-4635-9548-1b2eea395bca tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "POST /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.968037 Aug 24 09:02:19.996728 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 396/777] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 09:02:19 2022] POST /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/os-volume_attachments => generated 194 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:20.783503 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8f083258-7847-4653-83a7-c6a062af4563 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:20.784086 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8f083258-7847-4653-83a7-c6a062af4563 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:20.791605 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f083258-7847-4653-83a7-c6a062af4563 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:20.792105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f083258-7847-4653-83a7-c6a062af4563 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:20.792533 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f083258-7847-4653-83a7-c6a062af4563 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:20.793265 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f083258-7847-4653-83a7-c6a062af4563 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:20.793710 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f083258-7847-4653-83a7-c6a062af4563 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:20.794357 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f083258-7847-4653-83a7-c6a062af4563 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:20.934185 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8f083258-7847-4653-83a7-c6a062af4563 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:20.943333 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8f083258-7847-4653-83a7-c6a062af4563 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:20.945345 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8f083258-7847-4653-83a7-c6a062af4563 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:20.946511 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8f083258-7847-4653-83a7-c6a062af4563 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.167462 Aug 24 09:02:20.947117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 382/778] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:20 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:20.953967 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-bfbc2db6-a532-4ab5-9e7a-5f6f8beb3740 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:20.954664 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-bfbc2db6-a532-4ab5-9e7a-5f6f8beb3740 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:20.962516 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bfbc2db6-a532-4ab5-9e7a-5f6f8beb3740 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:20.963003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bfbc2db6-a532-4ab5-9e7a-5f6f8beb3740 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:20.963450 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bfbc2db6-a532-4ab5-9e7a-5f6f8beb3740 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:20.964153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bfbc2db6-a532-4ab5-9e7a-5f6f8beb3740 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:20.964626 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bfbc2db6-a532-4ab5-9e7a-5f6f8beb3740 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:20.965054 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bfbc2db6-a532-4ab5-9e7a-5f6f8beb3740 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:20.968201 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:21.116480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-bfbc2db6-a532-4ab5-9e7a-5f6f8beb3740 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:21.134336 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-bfbc2db6-a532-4ab5-9e7a-5f6f8beb3740 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.184492 Aug 24 09:02:21.134928 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 397/779] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:20 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:21.971488 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ed0b0cae-d2d6-4852-a9a4-5fec86dc530f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:21.972098 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ed0b0cae-d2d6-4852-a9a4-5fec86dc530f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:21.974545 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=60 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:21.980346 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed0b0cae-d2d6-4852-a9a4-5fec86dc530f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:21.980842 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed0b0cae-d2d6-4852-a9a4-5fec86dc530f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:21.981319 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed0b0cae-d2d6-4852-a9a4-5fec86dc530f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:21.982061 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed0b0cae-d2d6-4852-a9a4-5fec86dc530f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:21.982522 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed0b0cae-d2d6-4852-a9a4-5fec86dc530f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:21.983000 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed0b0cae-d2d6-4852-a9a4-5fec86dc530f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:22.150435 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ed0b0cae-d2d6-4852-a9a4-5fec86dc530f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:22.156205 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f1ce29c6-3b67-4b11-9d52-d9cb63ef3c0a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:22.164396 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f1ce29c6-3b67-4b11-9d52-d9cb63ef3c0a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:22.164657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ed0b0cae-d2d6-4852-a9a4-5fec86dc530f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:22.164657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ed0b0cae-d2d6-4852-a9a4-5fec86dc530f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:22.165805 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ed0b0cae-d2d6-4852-a9a4-5fec86dc530f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1808 microversion: 2.20 time: 0.198333 Aug 24 09:02:22.168581 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 383/780] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:21 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:22.169014 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f1ce29c6-3b67-4b11-9d52-d9cb63ef3c0a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:22.169014 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f1ce29c6-3b67-4b11-9d52-d9cb63ef3c0a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:22.169014 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f1ce29c6-3b67-4b11-9d52-d9cb63ef3c0a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:22.169578 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f1ce29c6-3b67-4b11-9d52-d9cb63ef3c0a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:22.170108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f1ce29c6-3b67-4b11-9d52-d9cb63ef3c0a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:22.170826 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f1ce29c6-3b67-4b11-9d52-d9cb63ef3c0a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:22.341827 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f1ce29c6-3b67-4b11-9d52-d9cb63ef3c0a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:22.351560 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f1ce29c6-3b67-4b11-9d52-d9cb63ef3c0a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.199616 Aug 24 09:02:22.352417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 398/781] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:22 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:23.230694 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-74dbc2a2-5967-49c1-8a63-46826e16d253 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:23.231811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-74dbc2a2-5967-49c1-8a63-46826e16d253 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:23.241186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-74dbc2a2-5967-49c1-8a63-46826e16d253 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:23.241710 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-74dbc2a2-5967-49c1-8a63-46826e16d253 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:23.242147 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-74dbc2a2-5967-49c1-8a63-46826e16d253 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:23.242859 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-74dbc2a2-5967-49c1-8a63-46826e16d253 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:23.243315 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-74dbc2a2-5967-49c1-8a63-46826e16d253 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:23.243739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-74dbc2a2-5967-49c1-8a63-46826e16d253 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:23.379779 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ed4fd826-86aa-43f2-bdab-f89916f5da1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:23.379779 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ed4fd826-86aa-43f2-bdab-f89916f5da1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:23.379779 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=56 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:23.383235 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ed4fd826-86aa-43f2-bdab-f89916f5da1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:23.383723 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ed4fd826-86aa-43f2-bdab-f89916f5da1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:23.384155 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ed4fd826-86aa-43f2-bdab-f89916f5da1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:23.384981 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ed4fd826-86aa-43f2-bdab-f89916f5da1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:23.385427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ed4fd826-86aa-43f2-bdab-f89916f5da1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:23.385845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ed4fd826-86aa-43f2-bdab-f89916f5da1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:23.387659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-74dbc2a2-5967-49c1-8a63-46826e16d253 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:23.403538 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-74dbc2a2-5967-49c1-8a63-46826e16d253 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:23.406375 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-74dbc2a2-5967-49c1-8a63-46826e16d253 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:23.407767 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-74dbc2a2-5967-49c1-8a63-46826e16d253 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1795 microversion: 2.20 time: 0.184151 Aug 24 09:02:23.408491 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 384/782] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:23 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1795 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:23.534745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ed4fd826-86aa-43f2-bdab-f89916f5da1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:23.544007 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ed4fd826-86aa-43f2-bdab-f89916f5da1c tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.173852 Aug 24 09:02:23.544618 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 399/783] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:23 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:24.566401 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c8952745-b5ee-4b4c-874d-5a34dedadbae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:24.567048 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c8952745-b5ee-4b4c-874d-5a34dedadbae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:24.574028 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c8952745-b5ee-4b4c-874d-5a34dedadbae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:24.574513 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c8952745-b5ee-4b4c-874d-5a34dedadbae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:24.574945 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c8952745-b5ee-4b4c-874d-5a34dedadbae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:24.575649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c8952745-b5ee-4b4c-874d-5a34dedadbae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:24.576179 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c8952745-b5ee-4b4c-874d-5a34dedadbae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:24.576660 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c8952745-b5ee-4b4c-874d-5a34dedadbae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:24.723344 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c8952745-b5ee-4b4c-874d-5a34dedadbae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:24.732526 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c8952745-b5ee-4b4c-874d-5a34dedadbae tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.170025 Aug 24 09:02:24.733136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 385/784] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:24 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:25.529601 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:02:25.529825 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Wed Aug 24 09:02:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:02:25.754708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f18c261c-aeab-418e-a99e-2f223fbfdce9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:25.755290 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f18c261c-aeab-418e-a99e-2f223fbfdce9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:25.758315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:25.763697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f18c261c-aeab-418e-a99e-2f223fbfdce9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:25.764224 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f18c261c-aeab-418e-a99e-2f223fbfdce9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:25.764720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f18c261c-aeab-418e-a99e-2f223fbfdce9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:25.772237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f18c261c-aeab-418e-a99e-2f223fbfdce9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:25.772237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f18c261c-aeab-418e-a99e-2f223fbfdce9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:25.772237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f18c261c-aeab-418e-a99e-2f223fbfdce9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:25.904258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f18c261c-aeab-418e-a99e-2f223fbfdce9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:25.912846 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f18c261c-aeab-418e-a99e-2f223fbfdce9 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.161991 Aug 24 09:02:25.913430 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 400/785] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:25 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:26.934349 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c3f1090d-bd26-42d9-b068-6fdfef5de760 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:26.934982 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c3f1090d-bd26-42d9-b068-6fdfef5de760 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:26.941758 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c3f1090d-bd26-42d9-b068-6fdfef5de760 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:26.942243 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c3f1090d-bd26-42d9-b068-6fdfef5de760 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:26.942674 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c3f1090d-bd26-42d9-b068-6fdfef5de760 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:26.943372 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c3f1090d-bd26-42d9-b068-6fdfef5de760 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:26.943824 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c3f1090d-bd26-42d9-b068-6fdfef5de760 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:26.944239 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c3f1090d-bd26-42d9-b068-6fdfef5de760 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:27.079386 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c3f1090d-bd26-42d9-b068-6fdfef5de760 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:27.088148 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c3f1090d-bd26-42d9-b068-6fdfef5de760 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.157841 Aug 24 09:02:27.088736 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 386/786] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:26 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:28.109364 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9c60f673-7f4c-44a0-b5cb-74712d80ab1b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:28.110029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9c60f673-7f4c-44a0-b5cb-74712d80ab1b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:28.116747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c60f673-7f4c-44a0-b5cb-74712d80ab1b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:28.117416 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c60f673-7f4c-44a0-b5cb-74712d80ab1b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:28.117676 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c60f673-7f4c-44a0-b5cb-74712d80ab1b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:28.118398 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c60f673-7f4c-44a0-b5cb-74712d80ab1b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:28.118843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c60f673-7f4c-44a0-b5cb-74712d80ab1b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:28.119263 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9c60f673-7f4c-44a0-b5cb-74712d80ab1b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:28.265545 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9c60f673-7f4c-44a0-b5cb-74712d80ab1b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:28.275083 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9c60f673-7f4c-44a0-b5cb-74712d80ab1b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.169530 Aug 24 09:02:28.275679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 401/787] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:28 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:28.727091 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-682259ca-72d1-4755-b8bb-bef2c3546309 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:28.727856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-682259ca-72d1-4755-b8bb-bef2c3546309 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:28.735080 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-682259ca-72d1-4755-b8bb-bef2c3546309 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:28.735565 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-682259ca-72d1-4755-b8bb-bef2c3546309 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:28.736011 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-682259ca-72d1-4755-b8bb-bef2c3546309 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:28.736773 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-682259ca-72d1-4755-b8bb-bef2c3546309 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:28.737224 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-682259ca-72d1-4755-b8bb-bef2c3546309 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:28.737678 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-682259ca-72d1-4755-b8bb-bef2c3546309 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:28.877285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-682259ca-72d1-4755-b8bb-bef2c3546309 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:28.886566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-682259ca-72d1-4755-b8bb-bef2c3546309 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1594 microversion: 2.1 time: 0.163409 Aug 24 09:02:28.887141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 387/788] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:28 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1594 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:29.297614 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b6e2cc00-3bdd-41da-99a5-1b465c5a6375 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:29.298344 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b6e2cc00-3bdd-41da-99a5-1b465c5a6375 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:29.305935 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b6e2cc00-3bdd-41da-99a5-1b465c5a6375 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:29.306430 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b6e2cc00-3bdd-41da-99a5-1b465c5a6375 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:29.306870 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b6e2cc00-3bdd-41da-99a5-1b465c5a6375 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:29.307607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b6e2cc00-3bdd-41da-99a5-1b465c5a6375 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:29.308057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b6e2cc00-3bdd-41da-99a5-1b465c5a6375 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:29.308485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b6e2cc00-3bdd-41da-99a5-1b465c5a6375 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:29.559133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b6e2cc00-3bdd-41da-99a5-1b465c5a6375 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:29.572653 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b6e2cc00-3bdd-41da-99a5-1b465c5a6375 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.278599 Aug 24 09:02:29.573708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 402/789] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:29 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:30.607633 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-17beb9dc-c477-46a9-a637-20665cdfcb57 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:30.608369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-17beb9dc-c477-46a9-a637-20665cdfcb57 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:30.615921 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-17beb9dc-c477-46a9-a637-20665cdfcb57 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:30.616587 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-17beb9dc-c477-46a9-a637-20665cdfcb57 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:30.617274 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-17beb9dc-c477-46a9-a637-20665cdfcb57 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:30.618012 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-17beb9dc-c477-46a9-a637-20665cdfcb57 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:30.618477 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-17beb9dc-c477-46a9-a637-20665cdfcb57 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:30.618905 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-17beb9dc-c477-46a9-a637-20665cdfcb57 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:30.787429 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-17beb9dc-c477-46a9-a637-20665cdfcb57 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:30.797787 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-17beb9dc-c477-46a9-a637-20665cdfcb57 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.194140 Aug 24 09:02:30.798465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 388/790] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:30 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:31.603668 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-bcd9fedf-26c1-419c-87b7-97d51e219921 req-20fb4377-fb56-422c-87cc-39bd963cbc21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc47a1d8-3769-47c2-b88d-3b75b26eddce", "tag": "8ded112a-e184-4f96-9bf7-0ce179e1f278"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:31.615348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-bcd9fedf-26c1-419c-87b7-97d51e219921 req-20fb4377-fb56-422c-87cc-39bd963cbc21 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:31.615836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-bcd9fedf-26c1-419c-87b7-97d51e219921 req-20fb4377-fb56-422c-87cc-39bd963cbc21 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:31.617077 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-bcd9fedf-26c1-419c-87b7-97d51e219921 req-20fb4377-fb56-422c-87cc-39bd963cbc21 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:31.630418 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-bcd9fedf-26c1-419c-87b7-97d51e219921 req-20fb4377-fb56-422c-87cc-39bd963cbc21 service nova] Creating event network-changed:8ded112a-e184-4f96-9bf7-0ce179e1f278 for instance fc47a1d8-3769-47c2-b88d-3b75b26eddce on hv-cinder-85221 Aug 24 09:02:31.636859 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-bcd9fedf-26c1-419c-87b7-97d51e219921 req-20fb4377-fb56-422c-87cc-39bd963cbc21 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037303 Aug 24 09:02:31.637454 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 403/791] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:31.824471 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-053e82f7-a04d-4274-8422-83487c537edd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:31.826609 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-053e82f7-a04d-4274-8422-83487c537edd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:31.836422 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-053e82f7-a04d-4274-8422-83487c537edd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:31.837395 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-053e82f7-a04d-4274-8422-83487c537edd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:31.838077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-053e82f7-a04d-4274-8422-83487c537edd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:31.839378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-053e82f7-a04d-4274-8422-83487c537edd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:31.840407 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-053e82f7-a04d-4274-8422-83487c537edd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:31.841446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-053e82f7-a04d-4274-8422-83487c537edd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:32.124046 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-053e82f7-a04d-4274-8422-83487c537edd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:32.139099 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-053e82f7-a04d-4274-8422-83487c537edd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.321771 Aug 24 09:02:32.139696 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 389/792] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:31 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:33.162714 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-879e43aa-5dc5-44f8-8bbe-fdc27492d3be tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:33.163577 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-879e43aa-5dc5-44f8-8bbe-fdc27492d3be tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:33.170205 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-879e43aa-5dc5-44f8-8bbe-fdc27492d3be tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:33.170703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-879e43aa-5dc5-44f8-8bbe-fdc27492d3be tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:33.171119 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-879e43aa-5dc5-44f8-8bbe-fdc27492d3be tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:33.171844 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-879e43aa-5dc5-44f8-8bbe-fdc27492d3be tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:33.172300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-879e43aa-5dc5-44f8-8bbe-fdc27492d3be tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:33.172765 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-879e43aa-5dc5-44f8-8bbe-fdc27492d3be tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:33.376532 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-879e43aa-5dc5-44f8-8bbe-fdc27492d3be tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:33.385884 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-879e43aa-5dc5-44f8-8bbe-fdc27492d3be tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.228025 Aug 24 09:02:33.386537 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 404/793] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:33 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:34.408096 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e616ad75-89d4-4d92-915d-6908c5e7398e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:34.408822 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e616ad75-89d4-4d92-915d-6908c5e7398e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:34.416295 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e616ad75-89d4-4d92-915d-6908c5e7398e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:34.416880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e616ad75-89d4-4d92-915d-6908c5e7398e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:34.417329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e616ad75-89d4-4d92-915d-6908c5e7398e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:34.418123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e616ad75-89d4-4d92-915d-6908c5e7398e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:34.418525 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e616ad75-89d4-4d92-915d-6908c5e7398e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:34.418976 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e616ad75-89d4-4d92-915d-6908c5e7398e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:34.575618 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e616ad75-89d4-4d92-915d-6908c5e7398e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:34.586090 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e616ad75-89d4-4d92-915d-6908c5e7398e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.181870 Aug 24 09:02:34.587043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 390/794] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:34 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:34.812307 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-61de7957-e8f9-4565-b6f5-c74f856d69d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-327348024"}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:34.813170 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-61de7957-e8f9-4565-b6f5-c74f856d69d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:34.820057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61de7957-e8f9-4565-b6f5-c74f856d69d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:34.820566 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61de7957-e8f9-4565-b6f5-c74f856d69d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:34.820999 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61de7957-e8f9-4565-b6f5-c74f856d69d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:34.821689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61de7957-e8f9-4565-b6f5-c74f856d69d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:34.822134 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61de7957-e8f9-4565-b6f5-c74f856d69d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:34.822550 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61de7957-e8f9-4565-b6f5-c74f856d69d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:34.955540 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.network.security_group_api [None req-61de7957-e8f9-4565-b6f5-c74f856d69d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Adding security group cdac2a92-65ed-40a1-b242-d2b2b7307af2 to port 8ded112a-e184-4f96-9bf7-0ce179e1f278 Aug 24 09:02:35.398825 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-61de7957-e8f9-4565-b6f5-c74f856d69d6 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "POST /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/action" status: 202 len: 0 microversion: 2.1 time: 0.590334 Aug 24 09:02:35.406370 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 405/795] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 09:02:34 2022] POST /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:02:35.408121 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5249a486-9637-4117-8519-c21741a9ee7a tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:35.408969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5249a486-9637-4117-8519-c21741a9ee7a tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:35.410625 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-9710e862-f776-4fe1-9f84-0b3b63295bb3 req-dbfd7020-b525-448c-bb31-0078dd9a055f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc47a1d8-3769-47c2-b88d-3b75b26eddce", "tag": "8ded112a-e184-4f96-9bf7-0ce179e1f278"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:35.415873 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5249a486-9637-4117-8519-c21741a9ee7a tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:35.416369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5249a486-9637-4117-8519-c21741a9ee7a tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:35.416993 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5249a486-9637-4117-8519-c21741a9ee7a tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:35.417706 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5249a486-9637-4117-8519-c21741a9ee7a tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:35.418157 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5249a486-9637-4117-8519-c21741a9ee7a tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:35.418578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5249a486-9637-4117-8519-c21741a9ee7a tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:35.422619 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-9710e862-f776-4fe1-9f84-0b3b63295bb3 req-dbfd7020-b525-448c-bb31-0078dd9a055f service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:35.423850 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-9710e862-f776-4fe1-9f84-0b3b63295bb3 req-dbfd7020-b525-448c-bb31-0078dd9a055f service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:35.423850 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-9710e862-f776-4fe1-9f84-0b3b63295bb3 req-dbfd7020-b525-448c-bb31-0078dd9a055f service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:35.456955 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-9710e862-f776-4fe1-9f84-0b3b63295bb3 req-dbfd7020-b525-448c-bb31-0078dd9a055f service nova] Creating event network-changed:8ded112a-e184-4f96-9bf7-0ce179e1f278 for instance fc47a1d8-3769-47c2-b88d-3b75b26eddce on hv-cinder-85221 Aug 24 09:02:35.467509 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-9710e862-f776-4fe1-9f84-0b3b63295bb3 req-dbfd7020-b525-448c-bb31-0078dd9a055f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061832 Aug 24 09:02:35.472215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 406/796] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:02:35.617999 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0f947a7c-b9b0-4ce0-b990-3f917d0dd500 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:35.618700 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0f947a7c-b9b0-4ce0-b990-3f917d0dd500 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:35.625386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f947a7c-b9b0-4ce0-b990-3f917d0dd500 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:35.625869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f947a7c-b9b0-4ce0-b990-3f917d0dd500 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:35.626299 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f947a7c-b9b0-4ce0-b990-3f917d0dd500 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:35.626994 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f947a7c-b9b0-4ce0-b990-3f917d0dd500 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:35.627644 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f947a7c-b9b0-4ce0-b990-3f917d0dd500 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:35.628061 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0f947a7c-b9b0-4ce0-b990-3f917d0dd500 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:35.645214 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5249a486-9637-4117-8519-c21741a9ee7a tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:35.660780 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5249a486-9637-4117-8519-c21741a9ee7a tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1758 microversion: 2.1 time: 0.256885 Aug 24 09:02:35.662129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 391/797] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:35 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1758 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:35.825200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0f947a7c-b9b0-4ce0-b990-3f917d0dd500 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:35.833246 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0f947a7c-b9b0-4ce0-b990-3f917d0dd500 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.218830 Aug 24 09:02:35.834422 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 407/798] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:35 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:36.862404 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ac5ebf25-3a46-4996-900d-d4c512dda7aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:36.863089 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ac5ebf25-3a46-4996-900d-d4c512dda7aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:36.869983 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac5ebf25-3a46-4996-900d-d4c512dda7aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:36.870467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac5ebf25-3a46-4996-900d-d4c512dda7aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:36.870902 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac5ebf25-3a46-4996-900d-d4c512dda7aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:36.871611 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac5ebf25-3a46-4996-900d-d4c512dda7aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:36.872059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac5ebf25-3a46-4996-900d-d4c512dda7aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:36.872472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ac5ebf25-3a46-4996-900d-d4c512dda7aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:37.039138 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ac5ebf25-3a46-4996-900d-d4c512dda7aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:37.047907 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ac5ebf25-3a46-4996-900d-d4c512dda7aa tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.189428 Aug 24 09:02:37.048503 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 392/799] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:36 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:38.079850 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-acf6d0ca-61aa-4881-934b-41292de33b36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:38.080433 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-acf6d0ca-61aa-4881-934b-41292de33b36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:38.087252 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-acf6d0ca-61aa-4881-934b-41292de33b36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:38.087725 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-acf6d0ca-61aa-4881-934b-41292de33b36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:38.088182 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-acf6d0ca-61aa-4881-934b-41292de33b36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:38.088940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-acf6d0ca-61aa-4881-934b-41292de33b36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:38.089381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-acf6d0ca-61aa-4881-934b-41292de33b36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:38.089795 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-acf6d0ca-61aa-4881-934b-41292de33b36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:38.244298 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-acf6d0ca-61aa-4881-934b-41292de33b36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:38.252808 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-acf6d0ca-61aa-4881-934b-41292de33b36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.176781 Aug 24 09:02:38.253388 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 408/800] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:38 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:39.274996 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-aaf3aaf4-7971-4dfa-9f20-0c27a34b25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:39.275659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-aaf3aaf4-7971-4dfa-9f20-0c27a34b25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:39.282539 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aaf3aaf4-7971-4dfa-9f20-0c27a34b25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:39.283022 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aaf3aaf4-7971-4dfa-9f20-0c27a34b25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:39.283464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aaf3aaf4-7971-4dfa-9f20-0c27a34b25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:39.284163 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aaf3aaf4-7971-4dfa-9f20-0c27a34b25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:39.284711 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aaf3aaf4-7971-4dfa-9f20-0c27a34b25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:39.285145 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aaf3aaf4-7971-4dfa-9f20-0c27a34b25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:39.423416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-aaf3aaf4-7971-4dfa-9f20-0c27a34b25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:39.431538 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-aaf3aaf4-7971-4dfa-9f20-0c27a34b25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.160994 Aug 24 09:02:39.432096 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 393/801] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:39 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:40.452325 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-11106fc0-481e-4d82-969d-c14dc88dbcbd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:40.452961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-11106fc0-481e-4d82-969d-c14dc88dbcbd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:40.459552 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11106fc0-481e-4d82-969d-c14dc88dbcbd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:40.460040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11106fc0-481e-4d82-969d-c14dc88dbcbd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:40.460482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11106fc0-481e-4d82-969d-c14dc88dbcbd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:40.461204 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11106fc0-481e-4d82-969d-c14dc88dbcbd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:40.461725 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11106fc0-481e-4d82-969d-c14dc88dbcbd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:40.462154 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11106fc0-481e-4d82-969d-c14dc88dbcbd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:40.599731 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-11106fc0-481e-4d82-969d-c14dc88dbcbd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:40.609094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-11106fc0-481e-4d82-969d-c14dc88dbcbd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.160553 Aug 24 09:02:40.609681 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 409/802] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:40 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:41.630633 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-779c29d7-0bc1-4159-abd9-2489f4ddca10 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:41.631381 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-779c29d7-0bc1-4159-abd9-2489f4ddca10 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:41.638871 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-779c29d7-0bc1-4159-abd9-2489f4ddca10 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:41.639353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-779c29d7-0bc1-4159-abd9-2489f4ddca10 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:41.639784 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-779c29d7-0bc1-4159-abd9-2489f4ddca10 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:41.640478 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-779c29d7-0bc1-4159-abd9-2489f4ddca10 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:41.640954 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-779c29d7-0bc1-4159-abd9-2489f4ddca10 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:41.641374 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-779c29d7-0bc1-4159-abd9-2489f4ddca10 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:41.785587 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-779c29d7-0bc1-4159-abd9-2489f4ddca10 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:41.808280 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-779c29d7-0bc1-4159-abd9-2489f4ddca10 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.181314 Aug 24 09:02:41.809193 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 394/803] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:41 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:42.832034 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fc8e6986-4ab2-4145-8100-fe9c20a475c1 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:42.832715 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fc8e6986-4ab2-4145-8100-fe9c20a475c1 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:42.840322 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fc8e6986-4ab2-4145-8100-fe9c20a475c1 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:42.840831 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fc8e6986-4ab2-4145-8100-fe9c20a475c1 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:42.841263 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fc8e6986-4ab2-4145-8100-fe9c20a475c1 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:42.841974 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fc8e6986-4ab2-4145-8100-fe9c20a475c1 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:42.842469 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fc8e6986-4ab2-4145-8100-fe9c20a475c1 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:42.842845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fc8e6986-4ab2-4145-8100-fe9c20a475c1 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:42.985819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fc8e6986-4ab2-4145-8100-fe9c20a475c1 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:43.000213 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fc8e6986-4ab2-4145-8100-fe9c20a475c1 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1736 microversion: 2.1 time: 0.171694 Aug 24 09:02:43.001314 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 410/804] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:42 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:44.026968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-16193bfd-f817-4232-9ae0-a9ae438241cc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:44.027620 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-16193bfd-f817-4232-9ae0-a9ae438241cc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:44.035185 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-16193bfd-f817-4232-9ae0-a9ae438241cc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:44.035683 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-16193bfd-f817-4232-9ae0-a9ae438241cc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:44.036114 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-16193bfd-f817-4232-9ae0-a9ae438241cc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:44.036890 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-16193bfd-f817-4232-9ae0-a9ae438241cc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:44.037337 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-16193bfd-f817-4232-9ae0-a9ae438241cc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:44.038294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-16193bfd-f817-4232-9ae0-a9ae438241cc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:44.181156 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-16193bfd-f817-4232-9ae0-a9ae438241cc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:44.197023 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-16193bfd-f817-4232-9ae0-a9ae438241cc tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1716 microversion: 2.1 time: 0.173911 Aug 24 09:02:44.198072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 395/805] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:44 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1716 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:44.319988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-734c3888-98d6-48cc-bf8e-aea82e7e8381 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:44.320677 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-734c3888-98d6-48cc-bf8e-aea82e7e8381 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:44.327459 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-734c3888-98d6-48cc-bf8e-aea82e7e8381 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:44.327942 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-734c3888-98d6-48cc-bf8e-aea82e7e8381 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:44.328373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-734c3888-98d6-48cc-bf8e-aea82e7e8381 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:44.329101 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-734c3888-98d6-48cc-bf8e-aea82e7e8381 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:44.329577 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-734c3888-98d6-48cc-bf8e-aea82e7e8381 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:44.330004 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-734c3888-98d6-48cc-bf8e-aea82e7e8381 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:44.463997 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-734c3888-98d6-48cc-bf8e-aea82e7e8381 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] HTTP exception thrown: Cannot 'detach_volume' instance b2342ef6-1538-4ed8-a880-4592faa068f5 while it is in vm_state rescued Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-734c3888-98d6-48cc-bf8e-aea82e7e8381 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Request method failure captured: Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: DELETE /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-volume_attachments/ad33876e-80fa-495d-90e2-8ebf9c9f4a93 HTTP/1.1 Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeVV9ImGTcRNmY4Hiln2vQcRMqL4RxwwQ_WIqLficzvTIx6Pz-RaHxnTth4Y2xKprHubC8bVxL5vpe6TejrqAfQJBa3lTvoqG4hzNbj0JnvBpSGphO-iVUfO5vGv_7r-6agc6A0AMKeemM4c2BBHlfPzWGZS8w3it_iG6hNJDNrWJE Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: c966c27f100846ca8cf06122ddc8c408 Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:02:44.466208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:02:44.467801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c966c27f100846ca8cf06122ddc8c408", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:02:44.467801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 09:02:44.467801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: c966c27f100846ca8cf06122ddc8c408 Aug 24 09:02:44.467801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 09:02:44.467801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-ServerRescueNegativeTestJSON-509348674-project Aug 24 09:02:44.467801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:02:44.467801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:02:44.467801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: f56524e822e641bc9bb11eddfe27f85d Aug 24 09:02:44.467801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-ServerRescueNegativeTestJSON-509348674-project Aug 24 09:02:44.467801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:02:44.467801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Cannot 'detach_volume' instance b2342ef6-1538-4ed8-a880-4592faa068f5 while it is in vm_state rescued Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'server_id': 'b2342ef6-1538-4ed8-a880-4592faa068f5', 'id': 'ad33876e-80fa-495d-90e2-8ebf9c9f4a93'} Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b2342ef6-1538-4ed8-a880-4592faa068f5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:02:44.468493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b2342ef6-1538-4ed8-a880-4592faa068f5 while it is in vm_state rescued Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b2342ef6-1538-4ed8-a880-4592faa068f5 while it is in vm_state rescued Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:02:44.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-734c3888-98d6-48cc-bf8e-aea82e7e8381 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Returning 409 to user: Cannot 'detach_volume' instance b2342ef6-1538-4ed8-a880-4592faa068f5 while it is in vm_state rescued {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:02:44.470863 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-734c3888-98d6-48cc-bf8e-aea82e7e8381 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-volume_attachments/ad33876e-80fa-495d-90e2-8ebf9c9f4a93" status: 409 len: 152 microversion: 2.1 time: 0.152306 Aug 24 09:02:44.470863 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 411/806] 10.222.0.55 () {58 vars in 1416 bytes} [Wed Aug 24 09:02:44 2022] DELETE /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-volume_attachments/ad33876e-80fa-495d-90e2-8ebf9c9f4a93 => generated 152 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 09:02:44.480217 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9506d13a-2a97-4670-a95d-e9c1117ebe5d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:44.481123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9506d13a-2a97-4670-a95d-e9c1117ebe5d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:44.492084 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9506d13a-2a97-4670-a95d-e9c1117ebe5d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:44.492949 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9506d13a-2a97-4670-a95d-e9c1117ebe5d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:44.493717 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9506d13a-2a97-4670-a95d-e9c1117ebe5d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:44.495041 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9506d13a-2a97-4670-a95d-e9c1117ebe5d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:44.495780 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9506d13a-2a97-4670-a95d-e9c1117ebe5d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:44.496379 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9506d13a-2a97-4670-a95d-e9c1117ebe5d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:44.633926 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:44.719679 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9506d13a-2a97-4670-a95d-e9c1117ebe5d tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "POST /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/action" status: 202 len: 0 microversion: 2.1 time: 0.245312 Aug 24 09:02:44.720519 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 396/807] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 09:02:44 2022] POST /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 09:02:44.729090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-057ebf83-6f63-49c7-8c39-93edf868a55a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:44.729736 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-057ebf83-6f63-49c7-8c39-93edf868a55a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:44.742611 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-057ebf83-6f63-49c7-8c39-93edf868a55a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:44.743360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-057ebf83-6f63-49c7-8c39-93edf868a55a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:44.743860 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-057ebf83-6f63-49c7-8c39-93edf868a55a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:44.745130 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-057ebf83-6f63-49c7-8c39-93edf868a55a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:44.745956 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-057ebf83-6f63-49c7-8c39-93edf868a55a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:44.746829 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-057ebf83-6f63-49c7-8c39-93edf868a55a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:45.075366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-057ebf83-6f63-49c7-8c39-93edf868a55a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:45.083851 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-057ebf83-6f63-49c7-8c39-93edf868a55a tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1724 microversion: 2.1 time: 0.358901 Aug 24 09:02:45.084415 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 412/808] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:44 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1724 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:46.107540 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7a5fcf34-b39b-41c5-905a-80ad7f2a7b85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:46.108218 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-7a5fcf34-b39b-41c5-905a-80ad7f2a7b85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:46.115071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7a5fcf34-b39b-41c5-905a-80ad7f2a7b85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:46.115533 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7a5fcf34-b39b-41c5-905a-80ad7f2a7b85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:46.115965 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7a5fcf34-b39b-41c5-905a-80ad7f2a7b85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:46.116692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7a5fcf34-b39b-41c5-905a-80ad7f2a7b85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:46.117141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7a5fcf34-b39b-41c5-905a-80ad7f2a7b85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:46.117563 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7a5fcf34-b39b-41c5-905a-80ad7f2a7b85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:46.259691 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7a5fcf34-b39b-41c5-905a-80ad7f2a7b85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:46.267884 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7a5fcf34-b39b-41c5-905a-80ad7f2a7b85 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1724 microversion: 2.1 time: 0.165131 Aug 24 09:02:46.268442 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 397/809] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:46 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:47.290313 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-27e25202-6de8-413b-96fc-c5a31c4a5fa2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:47.291041 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-27e25202-6de8-413b-96fc-c5a31c4a5fa2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:47.298267 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27e25202-6de8-413b-96fc-c5a31c4a5fa2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:47.298757 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27e25202-6de8-413b-96fc-c5a31c4a5fa2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:47.299189 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27e25202-6de8-413b-96fc-c5a31c4a5fa2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:47.299891 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27e25202-6de8-413b-96fc-c5a31c4a5fa2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:47.300345 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27e25202-6de8-413b-96fc-c5a31c4a5fa2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:47.300785 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27e25202-6de8-413b-96fc-c5a31c4a5fa2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:47.437234 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-27e25202-6de8-413b-96fc-c5a31c4a5fa2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:47.445624 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-27e25202-6de8-413b-96fc-c5a31c4a5fa2 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1724 microversion: 2.1 time: 0.159647 Aug 24 09:02:47.446183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 413/810] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:47 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:48.467197 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f27eed5d-e798-45d5-be1f-d40f984c1018 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:48.467891 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f27eed5d-e798-45d5-be1f-d40f984c1018 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:48.474925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f27eed5d-e798-45d5-be1f-d40f984c1018 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:48.475902 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f27eed5d-e798-45d5-be1f-d40f984c1018 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:48.476345 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f27eed5d-e798-45d5-be1f-d40f984c1018 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:48.477102 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f27eed5d-e798-45d5-be1f-d40f984c1018 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:48.477716 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f27eed5d-e798-45d5-be1f-d40f984c1018 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:48.478495 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f27eed5d-e798-45d5-be1f-d40f984c1018 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:48.621549 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f27eed5d-e798-45d5-be1f-d40f984c1018 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:48.629795 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f27eed5d-e798-45d5-be1f-d40f984c1018 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1724 microversion: 2.1 time: 0.166511 Aug 24 09:02:48.631311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 398/811] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:48 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:49.651456 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b91af25e-c35a-41bf-9abf-4045d98d25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:49.652092 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b91af25e-c35a-41bf-9abf-4045d98d25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:49.659106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b91af25e-c35a-41bf-9abf-4045d98d25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:49.659593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b91af25e-c35a-41bf-9abf-4045d98d25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:49.660021 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b91af25e-c35a-41bf-9abf-4045d98d25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:49.660744 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b91af25e-c35a-41bf-9abf-4045d98d25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:49.661195 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b91af25e-c35a-41bf-9abf-4045d98d25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:49.661654 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b91af25e-c35a-41bf-9abf-4045d98d25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:49.795713 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b91af25e-c35a-41bf-9abf-4045d98d25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:49.804680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b91af25e-c35a-41bf-9abf-4045d98d25b3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1730 microversion: 2.1 time: 0.157105 Aug 24 09:02:49.805251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 414/812] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:49 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:49.825556 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5bd050ce-18f2-4b2c-b3a8-6041ec42704f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:49.826117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5bd050ce-18f2-4b2c-b3a8-6041ec42704f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:49.832492 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5bd050ce-18f2-4b2c-b3a8-6041ec42704f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:49.832996 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5bd050ce-18f2-4b2c-b3a8-6041ec42704f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:49.833423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5bd050ce-18f2-4b2c-b3a8-6041ec42704f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:49.834099 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5bd050ce-18f2-4b2c-b3a8-6041ec42704f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:49.834542 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5bd050ce-18f2-4b2c-b3a8-6041ec42704f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:49.834960 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5bd050ce-18f2-4b2c-b3a8-6041ec42704f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:49.911368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5bd050ce-18f2-4b2c-b3a8-6041ec42704f tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089577 Aug 24 09:02:49.911946 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 399/813] 10.222.0.55 () {58 vars in 1275 bytes} [Wed Aug 24 09:02:49 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:50.785467 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-33f01a89-1266-4d54-8ee1-f2f502247679 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:50.786006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-33f01a89-1266-4d54-8ee1-f2f502247679 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:50.792470 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33f01a89-1266-4d54-8ee1-f2f502247679 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:50.793013 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33f01a89-1266-4d54-8ee1-f2f502247679 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:50.793447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33f01a89-1266-4d54-8ee1-f2f502247679 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:50.794141 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33f01a89-1266-4d54-8ee1-f2f502247679 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:50.794597 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33f01a89-1266-4d54-8ee1-f2f502247679 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:50.795014 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33f01a89-1266-4d54-8ee1-f2f502247679 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:50.809403 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:50.886673 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-e17a6bb3-b22a-4410-b2cf-508198b64b28 req-1584eab3-d162-4f48-a212-9d1af42528b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2342ef6-1538-4ed8-a880-4592faa068f5", "tag": "24078fe7-6b72-4110-8f91-0468c482387e"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:50.887228 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-33f01a89-1266-4d54-8ee1-f2f502247679 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lazy-loading 'services' on Instance uuid 9a46236b-ed03-4f8e-8eba-3d04a06056a1 {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:02:50.901888 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e17a6bb3-b22a-4410-b2cf-508198b64b28 req-1584eab3-d162-4f48-a212-9d1af42528b1 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:50.903360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e17a6bb3-b22a-4410-b2cf-508198b64b28 req-1584eab3-d162-4f48-a212-9d1af42528b1 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:50.904025 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e17a6bb3-b22a-4410-b2cf-508198b64b28 req-1584eab3-d162-4f48-a212-9d1af42528b1 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:50.923482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-e17a6bb3-b22a-4410-b2cf-508198b64b28 req-1584eab3-d162-4f48-a212-9d1af42528b1 service nova] Creating event network-changed:24078fe7-6b72-4110-8f91-0468c482387e for instance b2342ef6-1538-4ed8-a880-4592faa068f5 on hv-cinder-85221 Aug 24 09:02:50.929104 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-e17a6bb3-b22a-4410-b2cf-508198b64b28 req-1584eab3-d162-4f48-a212-9d1af42528b1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046553 Aug 24 09:02:50.929798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 400/814] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:51.144487 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-33f01a89-1266-4d54-8ee1-f2f502247679 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/os-volume_attachments/8168585d-62ca-4a1e-abe7-e62fd3a878dd" status: 202 len: 0 microversion: 2.1 time: 0.363242 Aug 24 09:02:51.148363 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 415/815] 10.222.0.55 () {58 vars in 1416 bytes} [Wed Aug 24 09:02:50 2022] DELETE /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/os-volume_attachments/8168585d-62ca-4a1e-abe7-e62fd3a878dd => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:02:52.945813 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-61fd3bbf-ee34-44e2-b831-c550ae974b6c req-5330bcba-793c-4293-a6cc-5b7b635e272d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2342ef6-1538-4ed8-a880-4592faa068f5", "tag": "24078fe7-6b72-4110-8f91-0468c482387e"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:52.951034 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=36 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:52.956751 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-61fd3bbf-ee34-44e2-b831-c550ae974b6c req-5330bcba-793c-4293-a6cc-5b7b635e272d service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:52.957221 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-61fd3bbf-ee34-44e2-b831-c550ae974b6c req-5330bcba-793c-4293-a6cc-5b7b635e272d service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:52.957672 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-61fd3bbf-ee34-44e2-b831-c550ae974b6c req-5330bcba-793c-4293-a6cc-5b7b635e272d service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:52.970950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-61fd3bbf-ee34-44e2-b831-c550ae974b6c req-5330bcba-793c-4293-a6cc-5b7b635e272d service nova] Creating event network-changed:24078fe7-6b72-4110-8f91-0468c482387e for instance b2342ef6-1538-4ed8-a880-4592faa068f5 on hv-cinder-85221 Aug 24 09:02:52.976469 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-61fd3bbf-ee34-44e2-b831-c550ae974b6c req-5330bcba-793c-4293-a6cc-5b7b635e272d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035773 Aug 24 09:02:52.977130 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 401/816] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:02:53.415030 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1ddf7e3c-4e9c-4580-a02a-6db9025d4ce4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:53.421955 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ddf7e3c-4e9c-4580-a02a-6db9025d4ce4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:53.422547 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ddf7e3c-4e9c-4580-a02a-6db9025d4ce4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:53.422989 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ddf7e3c-4e9c-4580-a02a-6db9025d4ce4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:53.453457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1ddf7e3c-4e9c-4580-a02a-6db9025d4ce4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Going to try to stop instance {{(pid=132984) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 09:02:53.651505 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1ddf7e3c-4e9c-4580-a02a-6db9025d4ce4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "POST /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/action" status: 202 len: 0 microversion: 2.1 time: 0.244280 Aug 24 09:02:53.652122 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 416/817] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 09:02:53 2022] POST /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:02:53.663902 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d2944b56-e78e-4941-8d79-1fd033138f93 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:53.665125 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d2944b56-e78e-4941-8d79-1fd033138f93 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:53.672887 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d2944b56-e78e-4941-8d79-1fd033138f93 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:53.673391 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d2944b56-e78e-4941-8d79-1fd033138f93 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:53.674078 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d2944b56-e78e-4941-8d79-1fd033138f93 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:53.674794 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d2944b56-e78e-4941-8d79-1fd033138f93 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:53.675251 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d2944b56-e78e-4941-8d79-1fd033138f93 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:53.675691 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d2944b56-e78e-4941-8d79-1fd033138f93 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:53.829333 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d2944b56-e78e-4941-8d79-1fd033138f93 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:53.837863 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d2944b56-e78e-4941-8d79-1fd033138f93 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1674 microversion: 2.1 time: 0.180433 Aug 24 09:02:53.838463 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 402/818] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:53 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:54.861807 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-15102bb7-5a8c-4248-a83b-b9b84503c8d2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:54.862717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-15102bb7-5a8c-4248-a83b-b9b84503c8d2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:54.864926 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=36 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:54.870979 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-15102bb7-5a8c-4248-a83b-b9b84503c8d2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:54.871472 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-15102bb7-5a8c-4248-a83b-b9b84503c8d2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:54.871915 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-15102bb7-5a8c-4248-a83b-b9b84503c8d2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:54.872746 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-15102bb7-5a8c-4248-a83b-b9b84503c8d2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:54.873238 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-15102bb7-5a8c-4248-a83b-b9b84503c8d2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:54.873670 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-15102bb7-5a8c-4248-a83b-b9b84503c8d2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:55.023186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-15102bb7-5a8c-4248-a83b-b9b84503c8d2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:55.036121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-15102bb7-5a8c-4248-a83b-b9b84503c8d2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1674 microversion: 2.1 time: 0.179529 Aug 24 09:02:55.036737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 417/819] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:54 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:56.057545 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-418a3e64-07ab-4d73-bbc4-5c4a3e7fabe5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:56.058184 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-418a3e64-07ab-4d73-bbc4-5c4a3e7fabe5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:56.064841 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-418a3e64-07ab-4d73-bbc4-5c4a3e7fabe5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:56.065327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-418a3e64-07ab-4d73-bbc4-5c4a3e7fabe5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:56.065754 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-418a3e64-07ab-4d73-bbc4-5c4a3e7fabe5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:56.066448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-418a3e64-07ab-4d73-bbc4-5c4a3e7fabe5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:56.066895 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-418a3e64-07ab-4d73-bbc4-5c4a3e7fabe5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:56.067314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-418a3e64-07ab-4d73-bbc4-5c4a3e7fabe5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:56.217378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-418a3e64-07ab-4d73-bbc4-5c4a3e7fabe5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:56.225580 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-418a3e64-07ab-4d73-bbc4-5c4a3e7fabe5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1674 microversion: 2.1 time: 0.171794 Aug 24 09:02:56.226134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 403/820] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:56 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:57.246941 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4dc65eed-c3b6-4920-b054-78e3eede0a1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:57.247585 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4dc65eed-c3b6-4920-b054-78e3eede0a1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:57.254227 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4dc65eed-c3b6-4920-b054-78e3eede0a1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:57.254720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4dc65eed-c3b6-4920-b054-78e3eede0a1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:57.255161 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4dc65eed-c3b6-4920-b054-78e3eede0a1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:57.255870 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4dc65eed-c3b6-4920-b054-78e3eede0a1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:57.256332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4dc65eed-c3b6-4920-b054-78e3eede0a1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:57.256794 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4dc65eed-c3b6-4920-b054-78e3eede0a1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:57.408432 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4dc65eed-c3b6-4920-b054-78e3eede0a1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:57.417148 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4dc65eed-c3b6-4920-b054-78e3eede0a1d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1674 microversion: 2.1 time: 0.174012 Aug 24 09:02:57.417724 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 418/821] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:57 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:58.437822 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7bb3678c-650c-481e-9070-f462a1ed9c82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:58.438401 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-7bb3678c-650c-481e-9070-f462a1ed9c82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:58.444981 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7bb3678c-650c-481e-9070-f462a1ed9c82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:58.445452 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7bb3678c-650c-481e-9070-f462a1ed9c82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:58.445880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7bb3678c-650c-481e-9070-f462a1ed9c82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:58.446604 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7bb3678c-650c-481e-9070-f462a1ed9c82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:58.447048 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7bb3678c-650c-481e-9070-f462a1ed9c82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:58.447465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7bb3678c-650c-481e-9070-f462a1ed9c82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:58.577796 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7bb3678c-650c-481e-9070-f462a1ed9c82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:58.586369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7bb3678c-650c-481e-9070-f462a1ed9c82 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1674 microversion: 2.1 time: 0.152350 Aug 24 09:02:58.586970 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 404/822] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:58 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:59.607912 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-058310c8-4452-4dae-b8c1-fe614570b793 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:59.608641 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-058310c8-4452-4dae-b8c1-fe614570b793 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:59.615112 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-058310c8-4452-4dae-b8c1-fe614570b793 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:59.615601 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-058310c8-4452-4dae-b8c1-fe614570b793 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:59.616038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-058310c8-4452-4dae-b8c1-fe614570b793 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:59.617313 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-058310c8-4452-4dae-b8c1-fe614570b793 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:59.617766 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-058310c8-4452-4dae-b8c1-fe614570b793 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:59.618192 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-058310c8-4452-4dae-b8c1-fe614570b793 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:59.755019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-058310c8-4452-4dae-b8c1-fe614570b793 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:59.763607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-058310c8-4452-4dae-b8c1-fe614570b793 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1674 microversion: 2.1 time: 0.159810 Aug 24 09:02:59.764203 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 419/823] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:59 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:00.786474 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cfe9dd4c-69fc-4922-b2ec-768a566159f3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:00.787109 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-cfe9dd4c-69fc-4922-b2ec-768a566159f3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:00.793771 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cfe9dd4c-69fc-4922-b2ec-768a566159f3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:00.794251 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cfe9dd4c-69fc-4922-b2ec-768a566159f3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:00.794675 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cfe9dd4c-69fc-4922-b2ec-768a566159f3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:00.795369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cfe9dd4c-69fc-4922-b2ec-768a566159f3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:00.795811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cfe9dd4c-69fc-4922-b2ec-768a566159f3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:00.796225 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cfe9dd4c-69fc-4922-b2ec-768a566159f3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:00.938999 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-cfe9dd4c-69fc-4922-b2ec-768a566159f3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:00.950278 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-cfe9dd4c-69fc-4922-b2ec-768a566159f3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1674 microversion: 2.1 time: 0.167832 Aug 24 09:03:00.950843 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 405/824] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:00 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:01.972988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-056919fb-70e8-470b-85f7-dfaf497b45d9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:01.973557 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-056919fb-70e8-470b-85f7-dfaf497b45d9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:01.980472 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-056919fb-70e8-470b-85f7-dfaf497b45d9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:01.981949 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-056919fb-70e8-470b-85f7-dfaf497b45d9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:01.982079 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-056919fb-70e8-470b-85f7-dfaf497b45d9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:01.982770 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-056919fb-70e8-470b-85f7-dfaf497b45d9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:01.983228 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-056919fb-70e8-470b-85f7-dfaf497b45d9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:01.983656 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-056919fb-70e8-470b-85f7-dfaf497b45d9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:02.126601 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-056919fb-70e8-470b-85f7-dfaf497b45d9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:02.134374 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-056919fb-70e8-470b-85f7-dfaf497b45d9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1674 microversion: 2.1 time: 0.165904 Aug 24 09:03:02.134957 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 420/825] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:01 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:03.155204 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b9b4d55c-60cb-45b4-a2b9-1afa8a70f696 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:03.155796 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b9b4d55c-60cb-45b4-a2b9-1afa8a70f696 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:03.162789 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b9b4d55c-60cb-45b4-a2b9-1afa8a70f696 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:03.164376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b9b4d55c-60cb-45b4-a2b9-1afa8a70f696 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:03.164376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b9b4d55c-60cb-45b4-a2b9-1afa8a70f696 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:03.164621 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b9b4d55c-60cb-45b4-a2b9-1afa8a70f696 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:03.164935 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b9b4d55c-60cb-45b4-a2b9-1afa8a70f696 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:03.165349 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b9b4d55c-60cb-45b4-a2b9-1afa8a70f696 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:03.298333 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b9b4d55c-60cb-45b4-a2b9-1afa8a70f696 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:03.306589 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b9b4d55c-60cb-45b4-a2b9-1afa8a70f696 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1674 microversion: 2.1 time: 0.155247 Aug 24 09:03:03.307155 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 406/826] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:03 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:04.328225 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1a6be697-2bda-4537-ad9c-1962f566fbfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:04.328862 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1a6be697-2bda-4537-ad9c-1962f566fbfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:04.336123 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1a6be697-2bda-4537-ad9c-1962f566fbfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:04.336655 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1a6be697-2bda-4537-ad9c-1962f566fbfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:04.337082 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1a6be697-2bda-4537-ad9c-1962f566fbfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:04.337776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1a6be697-2bda-4537-ad9c-1962f566fbfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:04.338230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1a6be697-2bda-4537-ad9c-1962f566fbfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:04.338649 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1a6be697-2bda-4537-ad9c-1962f566fbfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:04.472094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1a6be697-2bda-4537-ad9c-1962f566fbfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:04.480070 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1a6be697-2bda-4537-ad9c-1962f566fbfb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1651 microversion: 2.1 time: 0.155826 Aug 24 09:03:04.480663 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 421/827] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:04 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1651 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:04.500645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1d0e1541-e375-4aa4-b9f8-5999822360b1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:04.507835 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1d0e1541-e375-4aa4-b9f8-5999822360b1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:04.508317 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1d0e1541-e375-4aa4-b9f8-5999822360b1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:04.508792 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1d0e1541-e375-4aa4-b9f8-5999822360b1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:04.569135 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1d0e1541-e375-4aa4-b9f8-5999822360b1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Going to try to start instance {{(pid=132985) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 09:03:04.751620 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1d0e1541-e375-4aa4-b9f8-5999822360b1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "POST /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/action" status: 202 len: 0 microversion: 2.1 time: 0.254748 Aug 24 09:03:04.752223 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 407/828] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 09:03:04 2022] POST /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:03:04.761195 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8fcf2743-8ceb-48d2-b69f-2f73c41c84c3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:04.762698 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8fcf2743-8ceb-48d2-b69f-2f73c41c84c3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:04.767616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8fcf2743-8ceb-48d2-b69f-2f73c41c84c3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:04.768119 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8fcf2743-8ceb-48d2-b69f-2f73c41c84c3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:04.768564 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8fcf2743-8ceb-48d2-b69f-2f73c41c84c3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:04.769262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8fcf2743-8ceb-48d2-b69f-2f73c41c84c3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:04.769715 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8fcf2743-8ceb-48d2-b69f-2f73c41c84c3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:04.770136 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8fcf2743-8ceb-48d2-b69f-2f73c41c84c3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:04.906368 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8fcf2743-8ceb-48d2-b69f-2f73c41c84c3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:04.915737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8fcf2743-8ceb-48d2-b69f-2f73c41c84c3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1660 microversion: 2.1 time: 0.159160 Aug 24 09:03:04.917674 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 422/829] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:04 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1660 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:05.946445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-098cc8fd-bb53-4bec-bd26-8e0ef23d1514 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:05.947150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-098cc8fd-bb53-4bec-bd26-8e0ef23d1514 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:05.953340 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-098cc8fd-bb53-4bec-bd26-8e0ef23d1514 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:05.953820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-098cc8fd-bb53-4bec-bd26-8e0ef23d1514 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:05.954346 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-098cc8fd-bb53-4bec-bd26-8e0ef23d1514 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:05.955073 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-098cc8fd-bb53-4bec-bd26-8e0ef23d1514 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:05.955562 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-098cc8fd-bb53-4bec-bd26-8e0ef23d1514 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:05.956249 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-098cc8fd-bb53-4bec-bd26-8e0ef23d1514 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:06.093068 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-098cc8fd-bb53-4bec-bd26-8e0ef23d1514 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:06.100789 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-098cc8fd-bb53-4bec-bd26-8e0ef23d1514 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1660 microversion: 2.1 time: 0.167058 Aug 24 09:03:06.101352 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 408/830] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:05 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1660 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:07.121391 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4a0ff28e-e091-43c1-bc09-bd925882527d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:07.122607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4a0ff28e-e091-43c1-bc09-bd925882527d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:07.129995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a0ff28e-e091-43c1-bc09-bd925882527d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:07.130567 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a0ff28e-e091-43c1-bc09-bd925882527d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:07.131278 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a0ff28e-e091-43c1-bc09-bd925882527d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:07.132097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a0ff28e-e091-43c1-bc09-bd925882527d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:07.132893 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a0ff28e-e091-43c1-bc09-bd925882527d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:07.133443 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a0ff28e-e091-43c1-bc09-bd925882527d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:07.271685 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4a0ff28e-e091-43c1-bc09-bd925882527d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:07.279961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4a0ff28e-e091-43c1-bc09-bd925882527d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1664 microversion: 2.1 time: 0.162447 Aug 24 09:03:07.280529 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 423/831] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:07 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:20.827832 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ca521e46-8a33-4582-92ff-99dda4f18ba3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:20.828445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ca521e46-8a33-4582-92ff-99dda4f18ba3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:20.830957 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=15 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:20.831604 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=66,nova_cell1:UPDATE=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:20.836998 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ca521e46-8a33-4582-92ff-99dda4f18ba3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.839959 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ca521e46-8a33-4582-92ff-99dda4f18ba3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.839959 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ca521e46-8a33-4582-92ff-99dda4f18ba3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.839959 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ca521e46-8a33-4582-92ff-99dda4f18ba3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.839959 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ca521e46-8a33-4582-92ff-99dda4f18ba3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.840325 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ca521e46-8a33-4582-92ff-99dda4f18ba3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.863761 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ca521e46-8a33-4582-92ff-99dda4f18ba3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458/ips" status: 200 len: 150 microversion: 2.1 time: 0.039777 Aug 24 09:03:20.864438 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 409/832] 10.222.0.55 () {58 vars in 1248 bytes} [Wed Aug 24 09:03:20 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:03:20.875904 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-48e9dc0f-0c3d-444f-bc8d-aae37761a4f5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fdeb280-99e1-4444-ba43-36b195baf503"}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:20.878385 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-48e9dc0f-0c3d-444f-bc8d-aae37761a4f5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:20.880402 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=13 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:20.881076 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:20.886316 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-48e9dc0f-0c3d-444f-bc8d-aae37761a4f5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.886796 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-48e9dc0f-0c3d-444f-bc8d-aae37761a4f5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.887231 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-48e9dc0f-0c3d-444f-bc8d-aae37761a4f5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.887923 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-48e9dc0f-0c3d-444f-bc8d-aae37761a4f5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.888373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-48e9dc0f-0c3d-444f-bc8d-aae37761a4f5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.888894 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-48e9dc0f-0c3d-444f-bc8d-aae37761a4f5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.979657 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-48e9dc0f-0c3d-444f-bc8d-aae37761a4f5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Invalid volume: volume 6fdeb280-99e1-4444-ba43-36b195baf503 is already attached to instances: 635351cd-1139-4659-9d13-086372a9af7c Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-48e9dc0f-0c3d-444f-bc8d-aae37761a4f5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: POST /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458/os-volume_attachments HTTP/1.1 Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 74 Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:03:20.981457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:03:20.983200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:03:20.983200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:03:20.983200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:03:20.983200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:03:20.983200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:03:20.983200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:03:20.983200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:03:20.983200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:03:20.983200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:03:20.983200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Aug 24 09:03:20.983200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {"volumeAttachment": {"volumeId": "6fdeb280-99e1-4444-ba43-36b195baf503"}} Aug 24 09:03:20.983200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Invalid volume: volume 6fdeb280-99e1-4444-ba43-36b195baf503 is already attached to instances: 635351cd-1139-4659-9d13-086372a9af7c Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'server_id': '713b8af9-0654-40a5-bae9-0592267a0458', 'body': {'volumeAttachment': {'volumeId': '6fdeb280-99e1-4444-ba43-36b195baf503'}}} Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6fdeb280-99e1-4444-ba43-36b195baf503 is already attached to instances: 635351cd-1139-4659-9d13-086372a9af7c Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:03:20.984129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6fdeb280-99e1-4444-ba43-36b195baf503 is already attached to instances: 635351cd-1139-4659-9d13-086372a9af7c Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:20.985843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:20.987504 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:20.987504 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:03:20.987504 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:03:20.987504 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6fdeb280-99e1-4444-ba43-36b195baf503 is already attached to instances: 635351cd-1139-4659-9d13-086372a9af7c Aug 24 09:03:20.987504 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:03:20.987504 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-48e9dc0f-0c3d-444f-bc8d-aae37761a4f5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 400 to user: Invalid volume: volume 6fdeb280-99e1-4444-ba43-36b195baf503 is already attached to instances: 635351cd-1139-4659-9d13-086372a9af7c {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:03:20.987504 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-48e9dc0f-0c3d-444f-bc8d-aae37761a4f5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "POST /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111187 Aug 24 09:03:20.987504 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 424/833] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 09:03:20 2022] POST /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:03:20.993803 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4764195b-bd23-4ade-bc67-5b0fb52c1550 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:20.994326 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4764195b-bd23-4ade-bc67-5b0fb52c1550 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:21.000749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4764195b-bd23-4ade-bc67-5b0fb52c1550 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:21.001249 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4764195b-bd23-4ade-bc67-5b0fb52c1550 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:21.001677 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4764195b-bd23-4ade-bc67-5b0fb52c1550 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:21.002364 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4764195b-bd23-4ade-bc67-5b0fb52c1550 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:21.002811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4764195b-bd23-4ade-bc67-5b0fb52c1550 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:21.003228 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4764195b-bd23-4ade-bc67-5b0fb52c1550 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:21.029630 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4764195b-bd23-4ade-bc67-5b0fb52c1550 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Going to try to terminate instance {{(pid=132985) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:03:21.377792 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4764195b-bd23-4ade-bc67-5b0fb52c1550 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 204 len: 0 microversion: 2.1 time: 0.388103 Aug 24 09:03:21.378370 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 410/834] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:03:20 2022] DELETE /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:03:21.387271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-22fb3470-c7c2-4179-a9c0-12f8dfc7eac0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:21.389509 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-22fb3470-c7c2-4179-a9c0-12f8dfc7eac0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:21.394270 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22fb3470-c7c2-4179-a9c0-12f8dfc7eac0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:21.394745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22fb3470-c7c2-4179-a9c0-12f8dfc7eac0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:21.395175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22fb3470-c7c2-4179-a9c0-12f8dfc7eac0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:21.395861 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22fb3470-c7c2-4179-a9c0-12f8dfc7eac0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:21.396309 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22fb3470-c7c2-4179-a9c0-12f8dfc7eac0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:21.396759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-22fb3470-c7c2-4179-a9c0-12f8dfc7eac0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:21.537866 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-22fb3470-c7c2-4179-a9c0-12f8dfc7eac0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:21.546714 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-22fb3470-c7c2-4179-a9c0-12f8dfc7eac0 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1681 microversion: 2.1 time: 0.163871 Aug 24 09:03:21.551844 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 425/835] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:21 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:22.569563 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-47d1ca9b-004f-4a64-a4cc-1033cc44e122 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:22.570870 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-47d1ca9b-004f-4a64-a4cc-1033cc44e122 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:22.577570 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47d1ca9b-004f-4a64-a4cc-1033cc44e122 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:22.578052 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47d1ca9b-004f-4a64-a4cc-1033cc44e122 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:22.578481 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47d1ca9b-004f-4a64-a4cc-1033cc44e122 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:22.579170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47d1ca9b-004f-4a64-a4cc-1033cc44e122 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:22.579754 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47d1ca9b-004f-4a64-a4cc-1033cc44e122 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:22.580174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47d1ca9b-004f-4a64-a4cc-1033cc44e122 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:22.711165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-47d1ca9b-004f-4a64-a4cc-1033cc44e122 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:22.719044 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-47d1ca9b-004f-4a64-a4cc-1033cc44e122 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1681 microversion: 2.1 time: 0.153662 Aug 24 09:03:22.719604 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 411/836] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:22 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:23.742889 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-eff97f78-b9d7-450e-b4c1-9ba44fb13611 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:23.743448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-eff97f78-b9d7-450e-b4c1-9ba44fb13611 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:23.751102 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eff97f78-b9d7-450e-b4c1-9ba44fb13611 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:23.762635 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eff97f78-b9d7-450e-b4c1-9ba44fb13611 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:23.762635 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eff97f78-b9d7-450e-b4c1-9ba44fb13611 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:23.762635 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eff97f78-b9d7-450e-b4c1-9ba44fb13611 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:23.762635 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eff97f78-b9d7-450e-b4c1-9ba44fb13611 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:23.763103 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eff97f78-b9d7-450e-b4c1-9ba44fb13611 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:23.900713 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-eff97f78-b9d7-450e-b4c1-9ba44fb13611 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:23.909804 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-eff97f78-b9d7-450e-b4c1-9ba44fb13611 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1681 microversion: 2.1 time: 0.171409 Aug 24 09:03:23.910392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 426/837] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:23 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:24.546313 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-cd6604c1-dd21-4032-86a7-85f0706d0984 req-644bc8e9-e7ea-485f-aef3-fda5b58e6a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "713b8af9-0654-40a5-bae9-0592267a0458", "name": "network-vif-deleted", "tag": "a8514a53-9b36-48eb-9c4f-354a332273c4"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:24.556758 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-cd6604c1-dd21-4032-86a7-85f0706d0984 req-644bc8e9-e7ea-485f-aef3-fda5b58e6a3d service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:24.557224 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-cd6604c1-dd21-4032-86a7-85f0706d0984 req-644bc8e9-e7ea-485f-aef3-fda5b58e6a3d service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:24.557642 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-cd6604c1-dd21-4032-86a7-85f0706d0984 req-644bc8e9-e7ea-485f-aef3-fda5b58e6a3d service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:24.568769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-cd6604c1-dd21-4032-86a7-85f0706d0984 req-644bc8e9-e7ea-485f-aef3-fda5b58e6a3d service nova] Creating event network-vif-deleted:a8514a53-9b36-48eb-9c4f-354a332273c4 for instance 713b8af9-0654-40a5-bae9-0592267a0458 on hv-cinder-85221 Aug 24 09:03:24.573861 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-cd6604c1-dd21-4032-86a7-85f0706d0984 req-644bc8e9-e7ea-485f-aef3-fda5b58e6a3d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031209 Aug 24 09:03:24.574443 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 412/838] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:24.930821 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:24.931464 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:24.938213 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:24.938695 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:24.939128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:24.939829 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:24.940338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:24.940728 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:24.975143 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:24.975623 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:24.976812 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:24.977279 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lazy-loading 'fault' on Instance uuid 713b8af9-0654-40a5-bae9-0592267a0458 {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:03:25.019370 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:25.028111 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d5e8bb4c-a686-429e-8032-9882af0b3f69 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 200 len: 1331 microversion: 2.1 time: 0.101243 Aug 24 09:03:25.028740 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 427/839] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:24 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:26.050939 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a40e814f-c15f-45f1-adaa-42bb32a38459 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:26.051628 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a40e814f-c15f-45f1-adaa-42bb32a38459 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:26.058760 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a40e814f-c15f-45f1-adaa-42bb32a38459 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:26.059227 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a40e814f-c15f-45f1-adaa-42bb32a38459 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:26.059658 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a40e814f-c15f-45f1-adaa-42bb32a38459 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:26.060353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a40e814f-c15f-45f1-adaa-42bb32a38459 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:26.060823 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a40e814f-c15f-45f1-adaa-42bb32a38459 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:26.061242 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a40e814f-c15f-45f1-adaa-42bb32a38459 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:26.075517 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-a40e814f-c15f-45f1-adaa-42bb32a38459 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a40e814f-c15f-45f1-adaa-42bb32a38459 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 HTTP/1.1 Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:03:26.077448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:03:26.081108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:03:26.081108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:03:26.081108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:03:26.081108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:03:26.081108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:03:26.081108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:03:26.081108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:03:26.081108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:03:26.081108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:03:26.081108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:03:26.081108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:03:26.081108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': '713b8af9-0654-40a5-bae9-0592267a0458'} Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:03:26.082117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:03:26.085101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:03:26.087998 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a40e814f-c15f-45f1-adaa-42bb32a38459 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 404 to user: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:03:26.087998 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a40e814f-c15f-45f1-adaa-42bb32a38459 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 404 len: 111 microversion: 2.1 time: 0.032945 Aug 24 09:03:26.087998 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 413/840] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:26 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:03:26.099644 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c753a023-25a4-4913-b7b3-a659d8dd81c7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '.version_select at 0x7f16b2c4fa60>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:26.270642 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c753a023-25a4-4913-b7b3-a659d8dd81c7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-643443182" status: 202 len: 0 microversion: 2.1 time: 0.181402 Aug 24 09:03:26.271142 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 428/841] 10.222.0.55 () {58 vars in 1218 bytes} [Wed Aug 24 09:03:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-643443182 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:03:27.180926 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ebe8020f-8dfb-477e-af11-730cea0e6cff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:27.181793 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ebe8020f-8dfb-477e-af11-730cea0e6cff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:27.188660 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ebe8020f-8dfb-477e-af11-730cea0e6cff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:27.189152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ebe8020f-8dfb-477e-af11-730cea0e6cff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:27.189595 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ebe8020f-8dfb-477e-af11-730cea0e6cff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:27.190298 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ebe8020f-8dfb-477e-af11-730cea0e6cff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:27.190752 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ebe8020f-8dfb-477e-af11-730cea0e6cff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:27.191202 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ebe8020f-8dfb-477e-af11-730cea0e6cff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:27.293661 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-ebe8020f-8dfb-477e-af11-730cea0e6cff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lazy-loading 'services' on Instance uuid 635351cd-1139-4659-9d13-086372a9af7c {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:03:27.520636 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ebe8020f-8dfb-477e-af11-730cea0e6cff tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/os-volume_attachments/6fdeb280-99e1-4444-ba43-36b195baf503" status: 202 len: 0 microversion: 2.1 time: 0.343787 Aug 24 09:03:27.521248 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 414/842] 10.222.0.55 () {58 vars in 1416 bytes} [Wed Aug 24 09:03:27 2022] DELETE /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/os-volume_attachments/6fdeb280-99e1-4444-ba43-36b195baf503 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:03:27.530455 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9291ba62-246a-41d6-900d-e85511142c66 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:27.533639 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9291ba62-246a-41d6-900d-e85511142c66 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:27.541653 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9291ba62-246a-41d6-900d-e85511142c66 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:27.542142 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9291ba62-246a-41d6-900d-e85511142c66 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:27.542575 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9291ba62-246a-41d6-900d-e85511142c66 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:27.543273 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9291ba62-246a-41d6-900d-e85511142c66 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:27.543726 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9291ba62-246a-41d6-900d-e85511142c66 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:27.544246 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9291ba62-246a-41d6-900d-e85511142c66 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:27.574666 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9291ba62-246a-41d6-900d-e85511142c66 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048172 Aug 24 09:03:27.575293 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 429/843] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:03:27 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:28.588560 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-13be24de-b4b4-45f2-8243-2300b0dfee57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:28.590894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-13be24de-b4b4-45f2-8243-2300b0dfee57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:28.597144 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13be24de-b4b4-45f2-8243-2300b0dfee57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:28.597655 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13be24de-b4b4-45f2-8243-2300b0dfee57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:28.598124 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13be24de-b4b4-45f2-8243-2300b0dfee57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:28.598817 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13be24de-b4b4-45f2-8243-2300b0dfee57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:28.599263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13be24de-b4b4-45f2-8243-2300b0dfee57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:28.599686 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13be24de-b4b4-45f2-8243-2300b0dfee57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:28.628973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-13be24de-b4b4-45f2-8243-2300b0dfee57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045157 Aug 24 09:03:28.629522 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 415/844] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:03:28 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:29.641490 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0307b255-3844-4840-bf29-c6f3a61adb98 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:29.643654 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0307b255-3844-4840-bf29-c6f3a61adb98 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:29.650588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0307b255-3844-4840-bf29-c6f3a61adb98 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:29.651060 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0307b255-3844-4840-bf29-c6f3a61adb98 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:29.651488 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0307b255-3844-4840-bf29-c6f3a61adb98 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:29.652171 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0307b255-3844-4840-bf29-c6f3a61adb98 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:29.652652 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0307b255-3844-4840-bf29-c6f3a61adb98 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:29.653071 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0307b255-3844-4840-bf29-c6f3a61adb98 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:29.683552 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0307b255-3844-4840-bf29-c6f3a61adb98 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046011 Aug 24 09:03:29.684098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 430/845] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:03:29 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:03:29.745163 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9a7a1c5c-e6ee-4027-825b-a309435e758a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:29.755833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9a7a1c5c-e6ee-4027-825b-a309435e758a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:29.755833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a7a1c5c-e6ee-4027-825b-a309435e758a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:29.755833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a7a1c5c-e6ee-4027-825b-a309435e758a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:29.755833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a7a1c5c-e6ee-4027-825b-a309435e758a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:29.756256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a7a1c5c-e6ee-4027-825b-a309435e758a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:29.756256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a7a1c5c-e6ee-4027-825b-a309435e758a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:29.756256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9a7a1c5c-e6ee-4027-825b-a309435e758a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:29.780580 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9a7a1c5c-e6ee-4027-825b-a309435e758a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Going to try to terminate instance {{(pid=132985) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:03:30.058300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9a7a1c5c-e6ee-4027-825b-a309435e758a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 204 len: 0 microversion: 2.1 time: 0.316638 Aug 24 09:03:30.058883 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 416/846] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:03:29 2022] DELETE /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:03:30.067368 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e2183546-534f-4d18-a96d-1157eb842de9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:30.072582 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e2183546-534f-4d18-a96d-1157eb842de9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:30.074641 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e2183546-534f-4d18-a96d-1157eb842de9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:30.075128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e2183546-534f-4d18-a96d-1157eb842de9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:30.075564 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e2183546-534f-4d18-a96d-1157eb842de9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:30.076271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e2183546-534f-4d18-a96d-1157eb842de9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:30.076766 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e2183546-534f-4d18-a96d-1157eb842de9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:30.077195 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e2183546-534f-4d18-a96d-1157eb842de9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:30.213484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e2183546-534f-4d18-a96d-1157eb842de9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:30.223667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e2183546-534f-4d18-a96d-1157eb842de9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1682 microversion: 2.1 time: 0.159627 Aug 24 09:03:30.224736 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 431/847] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:30 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:31.247964 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4eb4233e-fcf0-414e-95e8-4225f97a240b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:31.248786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4eb4233e-fcf0-414e-95e8-4225f97a240b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:31.255608 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4eb4233e-fcf0-414e-95e8-4225f97a240b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:31.256221 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4eb4233e-fcf0-414e-95e8-4225f97a240b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:31.256701 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4eb4233e-fcf0-414e-95e8-4225f97a240b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:31.257391 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4eb4233e-fcf0-414e-95e8-4225f97a240b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:31.257833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4eb4233e-fcf0-414e-95e8-4225f97a240b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:31.258254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4eb4233e-fcf0-414e-95e8-4225f97a240b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:31.488306 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4eb4233e-fcf0-414e-95e8-4225f97a240b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:31.496864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4eb4233e-fcf0-414e-95e8-4225f97a240b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1682 microversion: 2.1 time: 0.253004 Aug 24 09:03:31.497538 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 417/848] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:31 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:32.323825 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-8758c4bc-2192-4efc-b755-5218c0184cbf req-8d6f1a23-80e2-49a4-8360-39cbb169aff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635351cd-1139-4659-9d13-086372a9af7c", "name": "network-vif-deleted", "tag": "4ab0306a-2019-48d9-9e7f-8476d77391d3"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:32.334086 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-8758c4bc-2192-4efc-b755-5218c0184cbf req-8d6f1a23-80e2-49a4-8360-39cbb169aff5 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:32.336002 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-8758c4bc-2192-4efc-b755-5218c0184cbf req-8d6f1a23-80e2-49a4-8360-39cbb169aff5 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:32.336002 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-8758c4bc-2192-4efc-b755-5218c0184cbf req-8d6f1a23-80e2-49a4-8360-39cbb169aff5 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:32.347270 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-8758c4bc-2192-4efc-b755-5218c0184cbf req-8d6f1a23-80e2-49a4-8360-39cbb169aff5 service nova] Creating event network-vif-deleted:4ab0306a-2019-48d9-9e7f-8476d77391d3 for instance 635351cd-1139-4659-9d13-086372a9af7c on hv-cinder-85221 Aug 24 09:03:32.352420 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-8758c4bc-2192-4efc-b755-5218c0184cbf req-8d6f1a23-80e2-49a4-8360-39cbb169aff5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032233 Aug 24 09:03:32.353730 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 432/849] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:32.528405 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ec841fc3-a555-4f1a-96aa-4f86bd9e22e3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:32.534491 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ec841fc3-a555-4f1a-96aa-4f86bd9e22e3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:32.544717 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec841fc3-a555-4f1a-96aa-4f86bd9e22e3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:32.545499 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec841fc3-a555-4f1a-96aa-4f86bd9e22e3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:32.546055 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec841fc3-a555-4f1a-96aa-4f86bd9e22e3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:32.546858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec841fc3-a555-4f1a-96aa-4f86bd9e22e3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:32.547414 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec841fc3-a555-4f1a-96aa-4f86bd9e22e3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:32.547973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec841fc3-a555-4f1a-96aa-4f86bd9e22e3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:32.614175 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ec841fc3-a555-4f1a-96aa-4f86bd9e22e3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:32.622333 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ec841fc3-a555-4f1a-96aa-4f86bd9e22e3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 200 len: 1327 microversion: 2.1 time: 0.098798 Aug 24 09:03:32.630820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 418/850] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:32 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:33.643972 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ecf67337-5260-4c84-827c-23b5749238d8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:33.644719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ecf67337-5260-4c84-827c-23b5749238d8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:33.651422 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ecf67337-5260-4c84-827c-23b5749238d8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:33.651918 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ecf67337-5260-4c84-827c-23b5749238d8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:33.652366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ecf67337-5260-4c84-827c-23b5749238d8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:33.653120 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ecf67337-5260-4c84-827c-23b5749238d8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:33.653512 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ecf67337-5260-4c84-827c-23b5749238d8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:33.653934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ecf67337-5260-4c84-827c-23b5749238d8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:33.668180 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-ecf67337-5260-4c84-827c-23b5749238d8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ecf67337-5260-4c84-827c-23b5749238d8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c HTTP/1.1 Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:03:33.669848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:03:33.671448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:03:33.671448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:03:33.671448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:03:33.671448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:03:33.671448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:03:33.671448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:03:33.671448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:03:33.671448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:03:33.671448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:03:33.671448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:03:33.671448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:03:33.671448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '635351cd-1139-4659-9d13-086372a9af7c'} Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:03:33.672318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:03:33.674064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:03:33.675875 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ecf67337-5260-4c84-827c-23b5749238d8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 404 to user: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:03:33.675875 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ecf67337-5260-4c84-827c-23b5749238d8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 404 len: 111 microversion: 2.1 time: 0.031704 Aug 24 09:03:33.675875 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 433/851] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:33 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:03:33.680292 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-32ffc0ba-f872-4364-8fe8-266003a1af52 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '.version_select at 0x7f16ae3a1700>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:33.779310 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-32ffc0ba-f872-4364-8fe8-266003a1af52 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540102404" status: 202 len: 0 microversion: 2.1 time: 0.102769 Aug 24 09:03:33.779888 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 419/852] 10.222.0.55 () {58 vars in 1221 bytes} [Wed Aug 24 09:03:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540102404 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 09:03:34.690528 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2e36ec13-551e-47af-b058-d7e0384c2fa5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Action: 'create', calling method: .version_select at 0x7f16ae358f70>, body: {"keypair": {"name": "tempest-keypair-1510326381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb7Sq6cYyYteZuEKegeKLoEUAgGIk/7o8HMws44xdfN00OiCAdjZR9tSCfCoJbYDOSXBJ2WPgIL2L/X5OfLDEIXt78WE+EimRcujmIZtL1HwH4dzAKGGp+i8x9nWmgCTw=="}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:34.706752 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-2e36ec13-551e-47af-b058-d7e0384c2fa5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for project 3809ac47fe214dda92729d4c89648a17. Resources: {'key_pairs'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:03:34.710719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-2e36ec13-551e-47af-b058-d7e0384c2fa5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for user 993697d33b7841668b1eabcdcd6b40f9 and project 3809ac47fe214dda92729d4c89648a17. Resources: {'key_pairs'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:03:34.807076 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2e36ec13-551e-47af-b058-d7e0384c2fa5 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119956 Aug 24 09:03:34.807676 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 434/853] 10.222.0.55 () {60 vars in 1159 bytes} [Wed Aug 24 09:03:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:37.330453 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-354558665", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce3c3cdc-b3eb-437a-9009-2b2f1c4b657c"}], "security_groups": [{"name": "tempest-securitygroup--818914698"}], "key_name": "tempest-keypair-1510326381", "user_data": "}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:37.446379 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.network.neutron [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] validate_networks() for [('ce3c3cdc-b3eb-437a-9009-2b2f1c4b657c', None, None, None, None, None)] {{(pid=132985) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:03:37.914802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Flavor limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:03:37.915219 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Image limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:03:37.915703 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Flavor pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:03:37.916105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Image pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:03:37.916507 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:03:37.925917 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:37.926384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:37.926836 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:37.927554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:37.927994 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:37.928406 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:37.945881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for project 3809ac47fe214dda92729d4c89648a17. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:03:37.950431 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for user 993697d33b7841668b1eabcdcd6b40f9 and project 3809ac47fe214dda92729d4c89648a17. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:03:37.961849 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Going to run 1 instances... {{(pid=132985) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:03:37.964791 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:03:38.099222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-321a1468-d4da-4bb3-924a-defea4bb9480 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.773804 Aug 24 09:03:38.099856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 420/854] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 09:03:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:03:38.111908 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-64589c93-ce00-4225-99e2-c451aff5a304 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:38.112663 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-64589c93-ce00-4225-99e2-c451aff5a304 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:38.168768 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-64589c93-ce00-4225-99e2-c451aff5a304 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:38.175738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-64589c93-ce00-4225-99e2-c451aff5a304 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1241 microversion: 2.1 time: 0.068367 Aug 24 09:03:38.176568 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 435/855] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:38 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:39.196282 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b0fab89c-8e06-464f-938f-08d211a1cb9b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:39.196915 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b0fab89c-8e06-464f-938f-08d211a1cb9b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:39.203766 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0fab89c-8e06-464f-938f-08d211a1cb9b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:39.204222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0fab89c-8e06-464f-938f-08d211a1cb9b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:39.204657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0fab89c-8e06-464f-938f-08d211a1cb9b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:39.205328 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0fab89c-8e06-464f-938f-08d211a1cb9b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:39.205769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0fab89c-8e06-464f-938f-08d211a1cb9b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:39.206181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0fab89c-8e06-464f-938f-08d211a1cb9b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:39.271967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b0fab89c-8e06-464f-938f-08d211a1cb9b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:39.280946 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b0fab89c-8e06-464f-938f-08d211a1cb9b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1245 microversion: 2.1 time: 0.088466 Aug 24 09:03:39.281780 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 421/856] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:39 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:40.022995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5a8e8999-89f7-4f46-bf31-6b05ae43e876 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:40.023541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5a8e8999-89f7-4f46-bf31-6b05ae43e876 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:40.030255 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5a8e8999-89f7-4f46-bf31-6b05ae43e876 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.030745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5a8e8999-89f7-4f46-bf31-6b05ae43e876 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.031185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5a8e8999-89f7-4f46-bf31-6b05ae43e876 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.032162 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5a8e8999-89f7-4f46-bf31-6b05ae43e876 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.032647 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5a8e8999-89f7-4f46-bf31-6b05ae43e876 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.033096 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5a8e8999-89f7-4f46-bf31-6b05ae43e876 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.065391 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5a8e8999-89f7-4f46-bf31-6b05ae43e876 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-volume_attachments/5145e73e-2994-4799-95fa-d1ed63ca633f" status: 200 len: 194 microversion: 2.20 time: 0.047657 Aug 24 09:03:40.066016 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 436/857] 10.222.0.55 () {60 vars in 1454 bytes} [Wed Aug 24 09:03:40 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-volume_attachments/5145e73e-2994-4799-95fa-d1ed63ca633f => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:03:40.149615 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-66ae12e0-666d-4b3d-aaa6-636b0ff50587 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:40.150107 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-66ae12e0-666d-4b3d-aaa6-636b0ff50587 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:40.156959 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-66ae12e0-666d-4b3d-aaa6-636b0ff50587 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.157438 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-66ae12e0-666d-4b3d-aaa6-636b0ff50587 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.157865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-66ae12e0-666d-4b3d-aaa6-636b0ff50587 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.158570 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-66ae12e0-666d-4b3d-aaa6-636b0ff50587 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.159017 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-66ae12e0-666d-4b3d-aaa6-636b0ff50587 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.159436 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-66ae12e0-666d-4b3d-aaa6-636b0ff50587 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.270288 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-66ae12e0-666d-4b3d-aaa6-636b0ff50587 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lazy-loading 'services' on Instance uuid abdb5828-315b-4046-9985-95e58a2f24b3 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:03:40.307660 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-14f0fbab-b312-43e9-a8b7-27851aaa3a94 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:40.308801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-14f0fbab-b312-43e9-a8b7-27851aaa3a94 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:40.321925 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-14f0fbab-b312-43e9-a8b7-27851aaa3a94 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.322901 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-14f0fbab-b312-43e9-a8b7-27851aaa3a94 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.323759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-14f0fbab-b312-43e9-a8b7-27851aaa3a94 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.325128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-14f0fbab-b312-43e9-a8b7-27851aaa3a94 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.326022 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-14f0fbab-b312-43e9-a8b7-27851aaa3a94 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.326887 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-14f0fbab-b312-43e9-a8b7-27851aaa3a94 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.414572 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-14f0fbab-b312-43e9-a8b7-27851aaa3a94 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:40.424076 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-14f0fbab-b312-43e9-a8b7-27851aaa3a94 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1293 microversion: 2.1 time: 0.124387 Aug 24 09:03:40.424694 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 437/858] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:40 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1293 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:40.522430 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-66ae12e0-666d-4b3d-aaa6-636b0ff50587 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "DELETE /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-volume_attachments/5145e73e-2994-4799-95fa-d1ed63ca633f" status: 202 len: 0 microversion: 2.20 time: 0.376531 Aug 24 09:03:40.548234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 422/859] 10.222.0.55 () {60 vars in 1457 bytes} [Wed Aug 24 09:03:40 2022] DELETE /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-volume_attachments/5145e73e-2994-4799-95fa-d1ed63ca633f => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:03:40.548405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-73d89a7b-def9-4301-8751-d67b79a2b8d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:40.548405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-73d89a7b-def9-4301-8751-d67b79a2b8d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:40.548405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-73d89a7b-def9-4301-8751-d67b79a2b8d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.548405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-73d89a7b-def9-4301-8751-d67b79a2b8d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.548876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-73d89a7b-def9-4301-8751-d67b79a2b8d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.548876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-73d89a7b-def9-4301-8751-d67b79a2b8d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.548876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-73d89a7b-def9-4301-8751-d67b79a2b8d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.548876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-73d89a7b-def9-4301-8751-d67b79a2b8d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.581223 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-73d89a7b-def9-4301-8751-d67b79a2b8d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052467 Aug 24 09:03:40.582658 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 438/860] 10.222.0.55 () {60 vars in 1343 bytes} [Wed Aug 24 09:03:40 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:03:41.450842 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7d69e983-4631-4a5b-902d-4140ef8dc852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:41.451566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-7d69e983-4631-4a5b-902d-4140ef8dc852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:41.460947 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7d69e983-4631-4a5b-902d-4140ef8dc852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:41.461458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7d69e983-4631-4a5b-902d-4140ef8dc852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:41.461904 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7d69e983-4631-4a5b-902d-4140ef8dc852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:41.462678 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7d69e983-4631-4a5b-902d-4140ef8dc852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:41.463269 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7d69e983-4631-4a5b-902d-4140ef8dc852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:41.463923 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7d69e983-4631-4a5b-902d-4140ef8dc852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:41.595711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-46a5b57d-895f-44d3-ae69-76570b65e0ab tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:41.598365 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-46a5b57d-895f-44d3-ae69-76570b65e0ab tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:41.606871 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-46a5b57d-895f-44d3-ae69-76570b65e0ab tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:41.607631 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-46a5b57d-895f-44d3-ae69-76570b65e0ab tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:41.608269 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-46a5b57d-895f-44d3-ae69-76570b65e0ab tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:41.609709 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-46a5b57d-895f-44d3-ae69-76570b65e0ab tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:41.610405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-46a5b57d-895f-44d3-ae69-76570b65e0ab tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:41.610902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-46a5b57d-895f-44d3-ae69-76570b65e0ab tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:41.634659 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7d69e983-4631-4a5b-902d-4140ef8dc852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:41.642717 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7d69e983-4631-4a5b-902d-4140ef8dc852 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1366 microversion: 2.1 time: 0.197611 Aug 24 09:03:41.643295 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 423/861] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:41 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:41.648490 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-46a5b57d-895f-44d3-ae69-76570b65e0ab tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057117 Aug 24 09:03:41.659299 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 439/862] 10.222.0.55 () {60 vars in 1343 bytes} [Wed Aug 24 09:03:41 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:03:42.663695 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-43be03ec-3c52-4a0a-b98a-eafb97d2ada2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:42.665187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-43be03ec-3c52-4a0a-b98a-eafb97d2ada2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:42.674262 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-43be03ec-3c52-4a0a-b98a-eafb97d2ada2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:42.674262 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-43be03ec-3c52-4a0a-b98a-eafb97d2ada2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:42.674564 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-518a6fce-541a-4bd9-9a51-f7d40afc9113 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:42.674998 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-43be03ec-3c52-4a0a-b98a-eafb97d2ada2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:42.674998 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-43be03ec-3c52-4a0a-b98a-eafb97d2ada2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:42.675191 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-43be03ec-3c52-4a0a-b98a-eafb97d2ada2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:42.675567 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-43be03ec-3c52-4a0a-b98a-eafb97d2ada2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:42.678414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-518a6fce-541a-4bd9-9a51-f7d40afc9113 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:42.680368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:42.690035 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-518a6fce-541a-4bd9-9a51-f7d40afc9113 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:42.690832 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-518a6fce-541a-4bd9-9a51-f7d40afc9113 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:42.691646 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-518a6fce-541a-4bd9-9a51-f7d40afc9113 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:42.692381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-518a6fce-541a-4bd9-9a51-f7d40afc9113 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:42.692933 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-518a6fce-541a-4bd9-9a51-f7d40afc9113 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:42.693364 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-518a6fce-541a-4bd9-9a51-f7d40afc9113 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:42.727093 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-518a6fce-541a-4bd9-9a51-f7d40afc9113 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058623 Aug 24 09:03:42.728080 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 440/863] 10.222.0.55 () {60 vars in 1343 bytes} [Wed Aug 24 09:03:42 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:42.733741 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-b4f85697-a902-4a5c-8ac1-badae55c5ddb req-581c1212-1121-44d3-a006-5fd7925b4e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a4092a-a4bd-4e9d-b8f8-20b94ac1451b", "tag": "bcebac0b-e063-449b-acc3-eaeffb5ab297"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:42.747657 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-b4f85697-a902-4a5c-8ac1-badae55c5ddb req-581c1212-1121-44d3-a006-5fd7925b4e80 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:42.748282 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-b4f85697-a902-4a5c-8ac1-badae55c5ddb req-581c1212-1121-44d3-a006-5fd7925b4e80 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:42.748804 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-b4f85697-a902-4a5c-8ac1-badae55c5ddb req-581c1212-1121-44d3-a006-5fd7925b4e80 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:42.762726 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-b4f85697-a902-4a5c-8ac1-badae55c5ddb req-581c1212-1121-44d3-a006-5fd7925b4e80 service nova] Creating event network-changed:bcebac0b-e063-449b-acc3-eaeffb5ab297 for instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b on hv-cinder-85221 Aug 24 09:03:42.768282 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-b4f85697-a902-4a5c-8ac1-badae55c5ddb req-581c1212-1121-44d3-a006-5fd7925b4e80 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038068 Aug 24 09:03:42.769353 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 441/864] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:42.826771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-857bf122-95a3-4a98-a269-c6174363210f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:42.827979 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-857bf122-95a3-4a98-a269-c6174363210f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:42.841759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-857bf122-95a3-4a98-a269-c6174363210f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:42.841759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-857bf122-95a3-4a98-a269-c6174363210f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:42.841759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-857bf122-95a3-4a98-a269-c6174363210f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:42.841759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-857bf122-95a3-4a98-a269-c6174363210f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:42.842264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-857bf122-95a3-4a98-a269-c6174363210f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:42.842264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-857bf122-95a3-4a98-a269-c6174363210f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:42.866322 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-857bf122-95a3-4a98-a269-c6174363210f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Going to try to terminate instance {{(pid=132984) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:03:42.897410 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-43be03ec-3c52-4a0a-b98a-eafb97d2ada2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:42.906090 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-43be03ec-3c52-4a0a-b98a-eafb97d2ada2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1366 microversion: 2.1 time: 0.246348 Aug 24 09:03:42.906934 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 424/865] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:42 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:43.171916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-857bf122-95a3-4a98-a269-c6174363210f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "DELETE /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 204 len: 0 microversion: 2.20 time: 0.349533 Aug 24 09:03:43.172529 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 442/866] 10.222.0.55 () {60 vars in 1280 bytes} [Wed Aug 24 09:03:42 2022] DELETE /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 09:03:43.180449 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8e7e1f95-d893-4be3-84f3-c12edf76150d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:43.181103 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8e7e1f95-d893-4be3-84f3-c12edf76150d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:43.187100 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8e7e1f95-d893-4be3-84f3-c12edf76150d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:43.187574 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8e7e1f95-d893-4be3-84f3-c12edf76150d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:43.188496 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8e7e1f95-d893-4be3-84f3-c12edf76150d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:43.188718 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8e7e1f95-d893-4be3-84f3-c12edf76150d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:43.189241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8e7e1f95-d893-4be3-84f3-c12edf76150d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:43.189578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8e7e1f95-d893-4be3-84f3-c12edf76150d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:43.318897 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8e7e1f95-d893-4be3-84f3-c12edf76150d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:43.327716 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8e7e1f95-d893-4be3-84f3-c12edf76150d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:43.329303 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8e7e1f95-d893-4be3-84f3-c12edf76150d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:43.330450 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8e7e1f95-d893-4be3-84f3-c12edf76150d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.153810 Aug 24 09:03:43.331007 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 425/867] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:43 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:03:43.928562 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-dc192fdc-70dc-4fd6-91d7-f2faadd7b9f9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:43.929336 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-dc192fdc-70dc-4fd6-91d7-f2faadd7b9f9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:43.936587 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dc192fdc-70dc-4fd6-91d7-f2faadd7b9f9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:43.937072 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dc192fdc-70dc-4fd6-91d7-f2faadd7b9f9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:43.937505 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dc192fdc-70dc-4fd6-91d7-f2faadd7b9f9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:43.938203 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dc192fdc-70dc-4fd6-91d7-f2faadd7b9f9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:43.938651 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dc192fdc-70dc-4fd6-91d7-f2faadd7b9f9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:43.939072 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-dc192fdc-70dc-4fd6-91d7-f2faadd7b9f9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:43.958065 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:44.081023 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-dc192fdc-70dc-4fd6-91d7-f2faadd7b9f9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:44.093251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-dc192fdc-70dc-4fd6-91d7-f2faadd7b9f9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1366 microversion: 2.1 time: 0.168687 Aug 24 09:03:44.094159 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 443/868] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:43 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:44.354858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-864b1f56-b4d5-4aca-9f9d-4fd385fa5465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:44.355445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-864b1f56-b4d5-4aca-9f9d-4fd385fa5465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:44.362276 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-864b1f56-b4d5-4aca-9f9d-4fd385fa5465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:44.362853 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-864b1f56-b4d5-4aca-9f9d-4fd385fa5465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:44.363326 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-864b1f56-b4d5-4aca-9f9d-4fd385fa5465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:44.364120 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-864b1f56-b4d5-4aca-9f9d-4fd385fa5465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:44.364665 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-864b1f56-b4d5-4aca-9f9d-4fd385fa5465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:44.365186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-864b1f56-b4d5-4aca-9f9d-4fd385fa5465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:44.498357 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-864b1f56-b4d5-4aca-9f9d-4fd385fa5465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:44.507243 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-864b1f56-b4d5-4aca-9f9d-4fd385fa5465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:44.508786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-864b1f56-b4d5-4aca-9f9d-4fd385fa5465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:44.510022 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-864b1f56-b4d5-4aca-9f9d-4fd385fa5465 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.159848 Aug 24 09:03:44.510580 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 426/869] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:44 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:03:45.127918 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-43cd6ff7-dd01-4e14-a4c9-baeee64e5f16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:45.128609 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-43cd6ff7-dd01-4e14-a4c9-baeee64e5f16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:45.137052 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-43cd6ff7-dd01-4e14-a4c9-baeee64e5f16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:45.137588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-43cd6ff7-dd01-4e14-a4c9-baeee64e5f16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:45.138317 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-43cd6ff7-dd01-4e14-a4c9-baeee64e5f16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:45.139203 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-43cd6ff7-dd01-4e14-a4c9-baeee64e5f16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:45.139752 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-43cd6ff7-dd01-4e14-a4c9-baeee64e5f16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:45.140455 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-43cd6ff7-dd01-4e14-a4c9-baeee64e5f16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:45.289127 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-43cd6ff7-dd01-4e14-a4c9-baeee64e5f16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:45.297264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-43cd6ff7-dd01-4e14-a4c9-baeee64e5f16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1366 microversion: 2.1 time: 0.173631 Aug 24 09:03:45.297854 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 444/870] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:45 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:45.533846 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4f6975f2-1e4e-47b1-a21b-bf7179ee4b13 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:45.534554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4f6975f2-1e4e-47b1-a21b-bf7179ee4b13 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:45.541872 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f6975f2-1e4e-47b1-a21b-bf7179ee4b13 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:45.542359 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f6975f2-1e4e-47b1-a21b-bf7179ee4b13 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:45.542786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f6975f2-1e4e-47b1-a21b-bf7179ee4b13 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:45.543481 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f6975f2-1e4e-47b1-a21b-bf7179ee4b13 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:45.543918 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f6975f2-1e4e-47b1-a21b-bf7179ee4b13 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:45.544331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4f6975f2-1e4e-47b1-a21b-bf7179ee4b13 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:45.682266 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4f6975f2-1e4e-47b1-a21b-bf7179ee4b13 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:45.690344 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4f6975f2-1e4e-47b1-a21b-bf7179ee4b13 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:45.691840 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4f6975f2-1e4e-47b1-a21b-bf7179ee4b13 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:45.693012 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4f6975f2-1e4e-47b1-a21b-bf7179ee4b13 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.163356 Aug 24 09:03:45.693570 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 427/871] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:45 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:03:46.322649 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-046aff71-66e6-43be-8d8b-4943d86c2c12 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:46.323256 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-046aff71-66e6-43be-8d8b-4943d86c2c12 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:46.329995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-046aff71-66e6-43be-8d8b-4943d86c2c12 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:46.330483 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-046aff71-66e6-43be-8d8b-4943d86c2c12 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:46.330920 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-046aff71-66e6-43be-8d8b-4943d86c2c12 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:46.331632 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-046aff71-66e6-43be-8d8b-4943d86c2c12 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:46.332084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-046aff71-66e6-43be-8d8b-4943d86c2c12 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:46.332512 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-046aff71-66e6-43be-8d8b-4943d86c2c12 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:46.467029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-046aff71-66e6-43be-8d8b-4943d86c2c12 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:46.475522 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-046aff71-66e6-43be-8d8b-4943d86c2c12 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1366 microversion: 2.1 time: 0.157200 Aug 24 09:03:46.476112 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 445/872] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:46 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:46.716380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f521db8b-2eda-4d47-aac6-9cc1ab26c4a0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:46.716964 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f521db8b-2eda-4d47-aac6-9cc1ab26c4a0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:46.723369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f521db8b-2eda-4d47-aac6-9cc1ab26c4a0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:46.723843 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f521db8b-2eda-4d47-aac6-9cc1ab26c4a0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:46.724276 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f521db8b-2eda-4d47-aac6-9cc1ab26c4a0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:46.724997 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f521db8b-2eda-4d47-aac6-9cc1ab26c4a0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:46.725447 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f521db8b-2eda-4d47-aac6-9cc1ab26c4a0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:46.725868 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f521db8b-2eda-4d47-aac6-9cc1ab26c4a0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:46.860229 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f521db8b-2eda-4d47-aac6-9cc1ab26c4a0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:46.868545 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f521db8b-2eda-4d47-aac6-9cc1ab26c4a0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:46.870575 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f521db8b-2eda-4d47-aac6-9cc1ab26c4a0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:46.871763 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f521db8b-2eda-4d47-aac6-9cc1ab26c4a0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.159372 Aug 24 09:03:46.872317 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 428/873] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:46 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:03:46.910995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5d8585f5-64af-4c2c-b72f-d9bad52b88c0 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:46.913257 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5d8585f5-64af-4c2c-b72f-d9bad52b88c0 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:46.919849 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5d8585f5-64af-4c2c-b72f-d9bad52b88c0 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:46.920359 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5d8585f5-64af-4c2c-b72f-d9bad52b88c0 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:46.920782 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5d8585f5-64af-4c2c-b72f-d9bad52b88c0 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:46.921475 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5d8585f5-64af-4c2c-b72f-d9bad52b88c0 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:46.921925 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5d8585f5-64af-4c2c-b72f-d9bad52b88c0 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:46.922352 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5d8585f5-64af-4c2c-b72f-d9bad52b88c0 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:47.118063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5d8585f5-64af-4c2c-b72f-d9bad52b88c0 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "POST /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/action" status: 202 len: 0 microversion: 2.1 time: 0.211158 Aug 24 09:03:47.119295 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 446/874] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 09:03:46 2022] POST /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:03:47.127529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-875aa238-24e5-4202-befd-a6ad0146aa41 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:47.128134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-875aa238-24e5-4202-befd-a6ad0146aa41 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:47.134566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-875aa238-24e5-4202-befd-a6ad0146aa41 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:47.134982 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-875aa238-24e5-4202-befd-a6ad0146aa41 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:47.135424 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-875aa238-24e5-4202-befd-a6ad0146aa41 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:47.136123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-875aa238-24e5-4202-befd-a6ad0146aa41 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:47.136601 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-875aa238-24e5-4202-befd-a6ad0146aa41 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:47.137023 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-875aa238-24e5-4202-befd-a6ad0146aa41 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:47.283376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-875aa238-24e5-4202-befd-a6ad0146aa41 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:47.292570 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-875aa238-24e5-4202-befd-a6ad0146aa41 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1750 microversion: 2.1 time: 0.168595 Aug 24 09:03:47.292892 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 429/875] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:47 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:47.497448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-414373d3-8590-41d7-9f64-2795dcc72d7f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:47.498062 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-414373d3-8590-41d7-9f64-2795dcc72d7f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:47.505042 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-414373d3-8590-41d7-9f64-2795dcc72d7f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:47.505532 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-414373d3-8590-41d7-9f64-2795dcc72d7f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:47.505967 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-414373d3-8590-41d7-9f64-2795dcc72d7f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:47.506672 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-414373d3-8590-41d7-9f64-2795dcc72d7f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:47.507123 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-414373d3-8590-41d7-9f64-2795dcc72d7f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:47.507546 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-414373d3-8590-41d7-9f64-2795dcc72d7f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:47.653931 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-414373d3-8590-41d7-9f64-2795dcc72d7f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:47.661986 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-414373d3-8590-41d7-9f64-2795dcc72d7f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1366 microversion: 2.1 time: 0.168982 Aug 24 09:03:47.662559 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 447/876] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:47 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:47.894565 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8cc4b005-1160-42fe-92cd-9c8c0bcb0241 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:47.895157 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8cc4b005-1160-42fe-92cd-9c8c0bcb0241 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:47.902340 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8cc4b005-1160-42fe-92cd-9c8c0bcb0241 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:47.902340 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8cc4b005-1160-42fe-92cd-9c8c0bcb0241 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:47.903227 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8cc4b005-1160-42fe-92cd-9c8c0bcb0241 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:47.903923 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8cc4b005-1160-42fe-92cd-9c8c0bcb0241 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:47.904364 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8cc4b005-1160-42fe-92cd-9c8c0bcb0241 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:47.904812 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8cc4b005-1160-42fe-92cd-9c8c0bcb0241 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:47.935389 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:47.957574 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=6 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:48.082287 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8cc4b005-1160-42fe-92cd-9c8c0bcb0241 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:48.091849 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8cc4b005-1160-42fe-92cd-9c8c0bcb0241 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:48.093652 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8cc4b005-1160-42fe-92cd-9c8c0bcb0241 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:48.094826 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8cc4b005-1160-42fe-92cd-9c8c0bcb0241 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1723 microversion: 2.20 time: 0.204230 Aug 24 09:03:48.095376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 430/877] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:47 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:03:48.317828 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e39a5912-71ae-4c2a-b08c-27c695324a4d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:48.318458 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e39a5912-71ae-4c2a-b08c-27c695324a4d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:48.329221 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=6 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:48.329856 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e39a5912-71ae-4c2a-b08c-27c695324a4d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:48.330352 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e39a5912-71ae-4c2a-b08c-27c695324a4d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:48.330788 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e39a5912-71ae-4c2a-b08c-27c695324a4d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:48.331496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e39a5912-71ae-4c2a-b08c-27c695324a4d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:48.331944 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e39a5912-71ae-4c2a-b08c-27c695324a4d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:48.332360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e39a5912-71ae-4c2a-b08c-27c695324a4d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:48.452412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-0504492b-4e8e-42ec-bb28-44ee345e75d6 req-38e88680-2d82-4e3c-b4b9-d69714ec7629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abdb5828-315b-4046-9985-95e58a2f24b3", "name": "network-vif-unplugged", "status": "completed", "tag": "756cdfb7-826d-4039-9977-c15d62078dd5"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:48.484678 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-0504492b-4e8e-42ec-bb28-44ee345e75d6 req-38e88680-2d82-4e3c-b4b9-d69714ec7629 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:48.485700 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-0504492b-4e8e-42ec-bb28-44ee345e75d6 req-38e88680-2d82-4e3c-b4b9-d69714ec7629 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:48.486321 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-0504492b-4e8e-42ec-bb28-44ee345e75d6 req-38e88680-2d82-4e3c-b4b9-d69714ec7629 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:48.503250 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-0504492b-4e8e-42ec-bb28-44ee345e75d6 req-38e88680-2d82-4e3c-b4b9-d69714ec7629 service nova] Creating event network-vif-unplugged:756cdfb7-826d-4039-9977-c15d62078dd5 for instance abdb5828-315b-4046-9985-95e58a2f24b3 on hv-cinder-85221 Aug 24 09:03:48.508568 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-0504492b-4e8e-42ec-bb28-44ee345e75d6 req-38e88680-2d82-4e3c-b4b9-d69714ec7629 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064230 Aug 24 09:03:48.509465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 431/878] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:48.604230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e39a5912-71ae-4c2a-b08c-27c695324a4d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:48.634181 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e39a5912-71ae-4c2a-b08c-27c695324a4d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1750 microversion: 2.1 time: 0.322020 Aug 24 09:03:48.636770 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 448/879] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:48 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1750 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:48.683066 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-85a45a98-9401-4cca-9b4a-bc9f9b569ab7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:48.683820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-85a45a98-9401-4cca-9b4a-bc9f9b569ab7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:48.691517 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-85a45a98-9401-4cca-9b4a-bc9f9b569ab7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:48.692110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-85a45a98-9401-4cca-9b4a-bc9f9b569ab7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:48.692443 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-85a45a98-9401-4cca-9b4a-bc9f9b569ab7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:48.693190 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-85a45a98-9401-4cca-9b4a-bc9f9b569ab7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:48.693646 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-85a45a98-9401-4cca-9b4a-bc9f9b569ab7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:48.694071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-85a45a98-9401-4cca-9b4a-bc9f9b569ab7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:48.976400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-85a45a98-9401-4cca-9b4a-bc9f9b569ab7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:48.984982 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-85a45a98-9401-4cca-9b4a-bc9f9b569ab7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1366 microversion: 2.1 time: 0.307018 Aug 24 09:03:48.985908 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 432/880] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:48 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:49.129197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-51b28c95-d116-467a-87e8-037e72e94fca tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:49.133577 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-51b28c95-d116-467a-87e8-037e72e94fca tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:49.159397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51b28c95-d116-467a-87e8-037e72e94fca tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:49.160342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51b28c95-d116-467a-87e8-037e72e94fca tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:49.161094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51b28c95-d116-467a-87e8-037e72e94fca tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:49.162289 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51b28c95-d116-467a-87e8-037e72e94fca tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:49.163083 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51b28c95-d116-467a-87e8-037e72e94fca tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:49.164564 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51b28c95-d116-467a-87e8-037e72e94fca tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:49.179640 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-6e0acfe6-a182-428c-b524-d21289e32a89 req-80f2776b-e79d-45fa-8523-962e2623d0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abdb5828-315b-4046-9985-95e58a2f24b3", "name": "network-vif-deleted", "tag": "756cdfb7-826d-4039-9977-c15d62078dd5"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:49.190069 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-6e0acfe6-a182-428c-b524-d21289e32a89 req-80f2776b-e79d-45fa-8523-962e2623d0a3 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:49.190547 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-6e0acfe6-a182-428c-b524-d21289e32a89 req-80f2776b-e79d-45fa-8523-962e2623d0a3 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:49.191559 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-6e0acfe6-a182-428c-b524-d21289e32a89 req-80f2776b-e79d-45fa-8523-962e2623d0a3 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:49.207308 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-6e0acfe6-a182-428c-b524-d21289e32a89 req-80f2776b-e79d-45fa-8523-962e2623d0a3 service nova] Creating event network-vif-deleted:756cdfb7-826d-4039-9977-c15d62078dd5 for instance abdb5828-315b-4046-9985-95e58a2f24b3 on hv-cinder-85221 Aug 24 09:03:49.214226 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-6e0acfe6-a182-428c-b524-d21289e32a89 req-80f2776b-e79d-45fa-8523-962e2623d0a3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039210 Aug 24 09:03:49.215133 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 433/881] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:03:49.390332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-51b28c95-d116-467a-87e8-037e72e94fca tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:49.411042 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-51b28c95-d116-467a-87e8-037e72e94fca tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:49.414835 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-51b28c95-d116-467a-87e8-037e72e94fca tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:49.421401 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-51b28c95-d116-467a-87e8-037e72e94fca tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1656 microversion: 2.20 time: 0.294917 Aug 24 09:03:49.421401 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 449/882] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:49 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1656 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:03:49.667217 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-444d1b67-ba16-45e3-8215-632fd9b63984 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:49.668302 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-444d1b67-ba16-45e3-8215-632fd9b63984 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:49.675044 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-444d1b67-ba16-45e3-8215-632fd9b63984 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:49.675548 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-444d1b67-ba16-45e3-8215-632fd9b63984 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:49.675986 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-444d1b67-ba16-45e3-8215-632fd9b63984 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:49.676755 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-444d1b67-ba16-45e3-8215-632fd9b63984 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:49.677519 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-444d1b67-ba16-45e3-8215-632fd9b63984 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:49.677910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-444d1b67-ba16-45e3-8215-632fd9b63984 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:49.846089 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-444d1b67-ba16-45e3-8215-632fd9b63984 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:49.855603 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-444d1b67-ba16-45e3-8215-632fd9b63984 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1755 microversion: 2.1 time: 0.192820 Aug 24 09:03:49.856208 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 434/883] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:49 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:50.005676 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b328b764-2123-4af7-81f5-da6fff0d98ee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:50.006286 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b328b764-2123-4af7-81f5-da6fff0d98ee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:50.013912 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b328b764-2123-4af7-81f5-da6fff0d98ee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:50.014477 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b328b764-2123-4af7-81f5-da6fff0d98ee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:50.014843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b328b764-2123-4af7-81f5-da6fff0d98ee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:50.015538 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b328b764-2123-4af7-81f5-da6fff0d98ee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:50.015982 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b328b764-2123-4af7-81f5-da6fff0d98ee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:50.016638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b328b764-2123-4af7-81f5-da6fff0d98ee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:50.169313 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b328b764-2123-4af7-81f5-da6fff0d98ee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:50.178342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b328b764-2123-4af7-81f5-da6fff0d98ee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1366 microversion: 2.1 time: 0.176464 Aug 24 09:03:50.178937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 450/884] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:50 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:50.442723 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:50.444009 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:50.451686 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:50.452108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:50.452555 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:50.453259 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:50.453702 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:50.454273 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:50.498900 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:50.499381 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:50.499813 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:50.500260 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lazy-loading 'fault' on Instance uuid abdb5828-315b-4046-9985-95e58a2f24b3 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:03:50.555519 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:50.565931 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:50.567426 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:50.569099 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8da5296c-f676-41e9-b1e9-dad0dec7b68d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 200 len: 1371 microversion: 2.20 time: 0.131193 Aug 24 09:03:50.569670 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 435/885] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:50 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 1371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:03:50.791043 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-ebfa2105-d6ed-405a-9d9f-fcb992ff9e51 req-e7d108ec-d220-4e38-80b8-1e6fd60545f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a4092a-a4bd-4e9d-b8f8-20b94ac1451b", "name": "network-vif-plugged", "status": "completed", "tag": "bcebac0b-e063-449b-acc3-eaeffb5ab297"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:50.803525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-ebfa2105-d6ed-405a-9d9f-fcb992ff9e51 req-e7d108ec-d220-4e38-80b8-1e6fd60545f6 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:50.804386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-ebfa2105-d6ed-405a-9d9f-fcb992ff9e51 req-e7d108ec-d220-4e38-80b8-1e6fd60545f6 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:50.805209 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-ebfa2105-d6ed-405a-9d9f-fcb992ff9e51 req-e7d108ec-d220-4e38-80b8-1e6fd60545f6 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:50.820118 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-ebfa2105-d6ed-405a-9d9f-fcb992ff9e51 req-e7d108ec-d220-4e38-80b8-1e6fd60545f6 service nova] Creating event network-vif-plugged:bcebac0b-e063-449b-acc3-eaeffb5ab297 for instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b on hv-cinder-85221 Aug 24 09:03:50.826087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-ebfa2105-d6ed-405a-9d9f-fcb992ff9e51 req-e7d108ec-d220-4e38-80b8-1e6fd60545f6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040003 Aug 24 09:03:50.826835 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 451/886] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:50.883252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-67ee6b24-feca-41a7-a4d5-7b32e71becc2 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:50.885004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-67ee6b24-feca-41a7-a4d5-7b32e71becc2 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:50.895754 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67ee6b24-feca-41a7-a4d5-7b32e71becc2 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:50.896304 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67ee6b24-feca-41a7-a4d5-7b32e71becc2 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:50.896773 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67ee6b24-feca-41a7-a4d5-7b32e71becc2 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:50.897515 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67ee6b24-feca-41a7-a4d5-7b32e71becc2 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:50.897964 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67ee6b24-feca-41a7-a4d5-7b32e71becc2 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:50.898369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-67ee6b24-feca-41a7-a4d5-7b32e71becc2 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:51.070906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-67ee6b24-feca-41a7-a4d5-7b32e71becc2 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:51.079670 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-67ee6b24-feca-41a7-a4d5-7b32e71becc2 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1755 microversion: 2.1 time: 0.203787 Aug 24 09:03:51.080242 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 436/887] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:50 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:51.212855 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e6dc169b-81b6-472c-930a-c8da79f5ee6b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:51.213581 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e6dc169b-81b6-472c-930a-c8da79f5ee6b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:51.215602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:51.220731 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e6dc169b-81b6-472c-930a-c8da79f5ee6b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:51.221218 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e6dc169b-81b6-472c-930a-c8da79f5ee6b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:51.221651 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e6dc169b-81b6-472c-930a-c8da79f5ee6b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:51.222359 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e6dc169b-81b6-472c-930a-c8da79f5ee6b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:51.222812 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e6dc169b-81b6-472c-930a-c8da79f5ee6b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:51.223232 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e6dc169b-81b6-472c-930a-c8da79f5ee6b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:51.375157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e6dc169b-81b6-472c-930a-c8da79f5ee6b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:51.387133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e6dc169b-81b6-472c-930a-c8da79f5ee6b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1366 microversion: 2.1 time: 0.179188 Aug 24 09:03:51.388197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 452/888] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:51 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:51.593867 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c88d2b71-c8c7-4641-a62c-0fde1d85944d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:51.594392 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c88d2b71-c8c7-4641-a62c-0fde1d85944d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:51.596877 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:51.601720 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c88d2b71-c8c7-4641-a62c-0fde1d85944d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:51.602220 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c88d2b71-c8c7-4641-a62c-0fde1d85944d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:51.602696 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c88d2b71-c8c7-4641-a62c-0fde1d85944d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:51.609256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c88d2b71-c8c7-4641-a62c-0fde1d85944d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:51.609256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c88d2b71-c8c7-4641-a62c-0fde1d85944d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:51.609256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c88d2b71-c8c7-4641-a62c-0fde1d85944d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:51.618152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-c88d2b71-c8c7-4641-a62c-0fde1d85944d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] HTTP exception thrown: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c88d2b71-c8c7-4641-a62c-0fde1d85944d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Request method failure captured: Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 HTTP/1.1 Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeS0VUTeaa4dQaFYAYtjGSAAH8CQ1jkTUMTLWdMuu2xN652lZr9uyUXik2VGDZNXALBwEUuzm5UFU1nuXz6mP8-9mv72c84JmwmibslJ-fUIlh7Z5W7GW54kI9yRPyPC7IqtoG-ZlnuTN8o1RfQh982xowr-0cuefNRE4y8XqTBq_w Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: a69447ca2f314084925442b7f8c9ee2e Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:03:51.619811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:03:51.621472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a69447ca2f314084925442b7f8c9ee2e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:03:51.621472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:03:51.621472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: a69447ca2f314084925442b7f8c9ee2e Aug 24 09:03:51.621472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:03:51.621472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-AttachVolumeShelveTestJSON-1781178415-project Aug 24 09:03:51.621472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:03:51.621472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:03:51.621472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 1105970982014891902ebbb9904a57a5 Aug 24 09:03:51.621472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781178415-project Aug 24 09:03:51.621472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:03:51.621472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:03:51.621472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': 'abdb5828-315b-4046-9985-95e58a2f24b3'} Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:03:51.622353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:03:51.623831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:03:51.625174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c88d2b71-c8c7-4641-a62c-0fde1d85944d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Returning 404 to user: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:03:51.625174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c88d2b71-c8c7-4641-a62c-0fde1d85944d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 404 len: 111 microversion: 2.20 time: 0.031383 Aug 24 09:03:51.625174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 437/889] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:51 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:03:51.630542 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b174f8c6-abe7-436d-af4f-580f6f949c0d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '.version_select at 0x7f16ae41d310>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:51.732790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b174f8c6-abe7-436d-af4f-580f6f949c0d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-606371214" status: 204 len: 0 microversion: 2.20 time: 0.106014 Aug 24 09:03:51.733369 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 453/890] 10.222.0.55 () {60 vars in 1259 bytes} [Wed Aug 24 09:03:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-606371214 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 09:03:52.101725 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-393e0a7e-40ae-4f10-a3cb-5d3a5026a57e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:52.102334 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-393e0a7e-40ae-4f10-a3cb-5d3a5026a57e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:52.111795 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-393e0a7e-40ae-4f10-a3cb-5d3a5026a57e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:52.112276 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-393e0a7e-40ae-4f10-a3cb-5d3a5026a57e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:52.112924 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-393e0a7e-40ae-4f10-a3cb-5d3a5026a57e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:52.113818 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-393e0a7e-40ae-4f10-a3cb-5d3a5026a57e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:52.114272 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-393e0a7e-40ae-4f10-a3cb-5d3a5026a57e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:52.114692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-393e0a7e-40ae-4f10-a3cb-5d3a5026a57e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:52.275784 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-393e0a7e-40ae-4f10-a3cb-5d3a5026a57e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:52.285149 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-393e0a7e-40ae-4f10-a3cb-5d3a5026a57e tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1755 microversion: 2.1 time: 0.187465 Aug 24 09:03:52.285731 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 438/891] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:52 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:52.423415 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f4119d4a-1387-4a75-a876-746de5b6c635 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:52.424014 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f4119d4a-1387-4a75-a876-746de5b6c635 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:52.430542 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f4119d4a-1387-4a75-a876-746de5b6c635 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:52.431079 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f4119d4a-1387-4a75-a876-746de5b6c635 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:52.431526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f4119d4a-1387-4a75-a876-746de5b6c635 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:52.432242 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f4119d4a-1387-4a75-a876-746de5b6c635 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:52.432728 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f4119d4a-1387-4a75-a876-746de5b6c635 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:52.433162 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f4119d4a-1387-4a75-a876-746de5b6c635 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:52.645479 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f4119d4a-1387-4a75-a876-746de5b6c635 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:52.650791 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f4119d4a-1387-4a75-a876-746de5b6c635 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1366 microversion: 2.1 time: 0.231883 Aug 24 09:03:52.651383 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 454/892] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:52 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:52.875369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e2406146-10c8-41ef-b8a0-17e6b6cba2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Action: 'create', calling method: .version_select at 0x7f16ae32bd30>, body: {"keypair": {"name": "tempest-keypair-2107859687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwLZCoOcyqqDsCBLM9pzYB08/Yarq9nK3OEVILQtD0I3yMvrij3m2nkAR1drlyIz5wTUh/1w6Ri0FlFfSGcPKLUsO0C19lI8dWWhAqJ36zFzJ1oX6SD9VGPncfM6xFBvg=="}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:52.891388 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-e2406146-10c8-41ef-b8a0-17e6b6cba2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Getting quotas for project a69447ca2f314084925442b7f8c9ee2e. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:03:52.895279 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-e2406146-10c8-41ef-b8a0-17e6b6cba2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Getting quotas for user 1105970982014891902ebbb9904a57a5 and project a69447ca2f314084925442b7f8c9ee2e. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:03:53.008021 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e2406146-10c8-41ef-b8a0-17e6b6cba2ed tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.136517 Aug 24 09:03:53.008842 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 439/893] 10.222.0.55 () {62 vars in 1200 bytes} [Wed Aug 24 09:03:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 09:03:53.307526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-623e5ad3-5265-4814-be7c-dab174b07a81 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:53.308148 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-623e5ad3-5265-4814-be7c-dab174b07a81 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:53.316043 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-623e5ad3-5265-4814-be7c-dab174b07a81 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:53.321545 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-623e5ad3-5265-4814-be7c-dab174b07a81 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:53.321545 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-623e5ad3-5265-4814-be7c-dab174b07a81 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:53.321545 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-623e5ad3-5265-4814-be7c-dab174b07a81 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:53.321545 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-623e5ad3-5265-4814-be7c-dab174b07a81 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:53.322301 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-623e5ad3-5265-4814-be7c-dab174b07a81 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:53.487546 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-623e5ad3-5265-4814-be7c-dab174b07a81 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:53.496488 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-623e5ad3-5265-4814-be7c-dab174b07a81 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1755 microversion: 2.1 time: 0.192812 Aug 24 09:03:53.497114 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 455/894] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:53 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:53.673602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e00c6fc4-57db-40f7-8c47-9e809b065f17 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:53.674211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e00c6fc4-57db-40f7-8c47-9e809b065f17 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:53.680531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e00c6fc4-57db-40f7-8c47-9e809b065f17 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:53.681046 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e00c6fc4-57db-40f7-8c47-9e809b065f17 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:53.681473 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e00c6fc4-57db-40f7-8c47-9e809b065f17 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:53.682170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e00c6fc4-57db-40f7-8c47-9e809b065f17 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:53.682616 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e00c6fc4-57db-40f7-8c47-9e809b065f17 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:53.683026 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e00c6fc4-57db-40f7-8c47-9e809b065f17 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:53.833938 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e00c6fc4-57db-40f7-8c47-9e809b065f17 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:53.842957 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e00c6fc4-57db-40f7-8c47-9e809b065f17 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1555 microversion: 2.1 time: 0.173238 Aug 24 09:03:53.843552 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 440/895] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:53 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:53.865456 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fce3c365-e758-4409-9cc4-4c056674353e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:53.866510 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fce3c365-e758-4409-9cc4-4c056674353e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:53.874039 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fce3c365-e758-4409-9cc4-4c056674353e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:53.874679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fce3c365-e758-4409-9cc4-4c056674353e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:53.875186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fce3c365-e758-4409-9cc4-4c056674353e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:53.875968 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fce3c365-e758-4409-9cc4-4c056674353e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:53.876492 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fce3c365-e758-4409-9cc4-4c056674353e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:53.876955 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fce3c365-e758-4409-9cc4-4c056674353e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:53.981079 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fce3c365-e758-4409-9cc4-4c056674353e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121285 Aug 24 09:03:53.981678 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 456/896] 10.222.0.55 () {58 vars in 1275 bytes} [Wed Aug 24 09:03:53 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:54.526985 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0e9d8571-74d7-4402-a84b-699e41b17828 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:54.527779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0e9d8571-74d7-4402-a84b-699e41b17828 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:54.535083 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0e9d8571-74d7-4402-a84b-699e41b17828 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:54.535492 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0e9d8571-74d7-4402-a84b-699e41b17828 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:54.535928 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0e9d8571-74d7-4402-a84b-699e41b17828 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:54.536667 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0e9d8571-74d7-4402-a84b-699e41b17828 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:54.537123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0e9d8571-74d7-4402-a84b-699e41b17828 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:54.537538 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0e9d8571-74d7-4402-a84b-699e41b17828 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:54.822348 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0e9d8571-74d7-4402-a84b-699e41b17828 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:54.840680 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0e9d8571-74d7-4402-a84b-699e41b17828 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1755 microversion: 2.1 time: 0.315753 Aug 24 09:03:54.841470 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 441/897] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:54 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1755 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:55.164416 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-afb29a32-583f-4710-b00f-40265f0da744 req-efaa36a3-1906-4dff-8dbe-a705db19d913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a4092a-a4bd-4e9d-b8f8-20b94ac1451b", "tag": "bcebac0b-e063-449b-acc3-eaeffb5ab297"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:55.174974 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-afb29a32-583f-4710-b00f-40265f0da744 req-efaa36a3-1906-4dff-8dbe-a705db19d913 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:55.178370 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-afb29a32-583f-4710-b00f-40265f0da744 req-efaa36a3-1906-4dff-8dbe-a705db19d913 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:55.178370 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-afb29a32-583f-4710-b00f-40265f0da744 req-efaa36a3-1906-4dff-8dbe-a705db19d913 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:55.188778 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-afb29a32-583f-4710-b00f-40265f0da744 req-efaa36a3-1906-4dff-8dbe-a705db19d913 service nova] Creating event network-changed:bcebac0b-e063-449b-acc3-eaeffb5ab297 for instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b on hv-cinder-85221 Aug 24 09:03:55.195389 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-afb29a32-583f-4710-b00f-40265f0da744 req-efaa36a3-1906-4dff-8dbe-a705db19d913 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035364 Aug 24 09:03:55.196033 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 457/898] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:03:55.638777 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1838091589", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe1af59a-c9c9-44db-b32e-f7711ec613c6"}], "security_groups": [{"name": "tempest-securitygroup--1181364737"}], "key_name": "tempest-keypair-2107859687", "user_data": "}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:55.793781 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.network.neutron [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] validate_networks() for [('fe1af59a-c9c9-44db-b32e-f7711ec613c6', None, None, None, None, None)] {{(pid=132985) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:03:55.867471 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-eddd7d0f-d0c6-4e03-a366-5bf8c11292b5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:55.869018 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-eddd7d0f-d0c6-4e03-a366-5bf8c11292b5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:55.876155 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eddd7d0f-d0c6-4e03-a366-5bf8c11292b5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:55.876956 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eddd7d0f-d0c6-4e03-a366-5bf8c11292b5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:55.877405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eddd7d0f-d0c6-4e03-a366-5bf8c11292b5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:55.878127 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eddd7d0f-d0c6-4e03-a366-5bf8c11292b5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:55.878752 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eddd7d0f-d0c6-4e03-a366-5bf8c11292b5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:55.879461 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eddd7d0f-d0c6-4e03-a366-5bf8c11292b5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:56.093327 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-eddd7d0f-d0c6-4e03-a366-5bf8c11292b5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:56.105239 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-eddd7d0f-d0c6-4e03-a366-5bf8c11292b5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1755 microversion: 2.1 time: 0.242014 Aug 24 09:03:56.105952 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 458/899] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:55 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1755 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:56.549170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Flavor limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:03:56.549594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Image limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:03:56.550063 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Flavor pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:03:56.550467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Image pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:03:56.550898 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:03:56.559936 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:56.560412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:56.560863 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:56.561583 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:56.562022 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:56.562434 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:56.579305 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Getting quotas for project a69447ca2f314084925442b7f8c9ee2e. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:03:56.583422 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Getting quotas for user 1105970982014891902ebbb9904a57a5 and project a69447ca2f314084925442b7f8c9ee2e. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:03:56.594925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Going to run 1 instances... {{(pid=132985) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:03:56.597219 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:03:56.722861 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-45931bd2-fefd-4d23-b20d-a7438733877e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.090430 Aug 24 09:03:56.723568 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 442/900] 10.222.0.55 () {62 vars in 1188 bytes} [Wed Aug 24 09:03:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 09:03:56.735017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7398d426-1070-4d1b-9b8f-26b9020bd6c9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:56.735636 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7398d426-1070-4d1b-9b8f-26b9020bd6c9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:56.790537 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7398d426-1070-4d1b-9b8f-26b9020bd6c9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:56.799232 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7398d426-1070-4d1b-9b8f-26b9020bd6c9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:56.800788 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7398d426-1070-4d1b-9b8f-26b9020bd6c9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:56.801905 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7398d426-1070-4d1b-9b8f-26b9020bd6c9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1282 microversion: 2.20 time: 0.070976 Aug 24 09:03:56.802468 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 459/901] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:56 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:03:57.128473 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ab3ede78-7399-4cc0-8a0c-6b4a1d85135d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:57.129338 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ab3ede78-7399-4cc0-8a0c-6b4a1d85135d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:57.136906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab3ede78-7399-4cc0-8a0c-6b4a1d85135d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:57.137389 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab3ede78-7399-4cc0-8a0c-6b4a1d85135d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:57.137820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab3ede78-7399-4cc0-8a0c-6b4a1d85135d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:57.138513 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab3ede78-7399-4cc0-8a0c-6b4a1d85135d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:57.138954 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab3ede78-7399-4cc0-8a0c-6b4a1d85135d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:57.139366 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ab3ede78-7399-4cc0-8a0c-6b4a1d85135d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:57.293274 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ab3ede78-7399-4cc0-8a0c-6b4a1d85135d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:57.310732 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ab3ede78-7399-4cc0-8a0c-6b4a1d85135d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1755 microversion: 2.1 time: 0.186106 Aug 24 09:03:57.311336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 443/902] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:57 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:57.439582 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3c6c0c52-55e1-4883-b0d7-ee367340c5d5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:57.440072 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3c6c0c52-55e1-4883-b0d7-ee367340c5d5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:57.447264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c6c0c52-55e1-4883-b0d7-ee367340c5d5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:57.447755 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c6c0c52-55e1-4883-b0d7-ee367340c5d5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:57.448185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c6c0c52-55e1-4883-b0d7-ee367340c5d5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:57.448918 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c6c0c52-55e1-4883-b0d7-ee367340c5d5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:57.449371 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c6c0c52-55e1-4883-b0d7-ee367340c5d5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:57.449792 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c6c0c52-55e1-4883-b0d7-ee367340c5d5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:57.539069 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-3c6c0c52-55e1-4883-b0d7-ee367340c5d5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lazy-loading 'services' on Instance uuid b2342ef6-1538-4ed8-a880-4592faa068f5 {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:03:57.766441 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3c6c0c52-55e1-4883-b0d7-ee367340c5d5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-volume_attachments/ad33876e-80fa-495d-90e2-8ebf9c9f4a93" status: 202 len: 0 microversion: 2.1 time: 0.330650 Aug 24 09:03:57.770811 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 460/903] 10.222.0.55 () {58 vars in 1416 bytes} [Wed Aug 24 09:03:57 2022] DELETE /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-volume_attachments/ad33876e-80fa-495d-90e2-8ebf9c9f4a93 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:03:57.780975 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5219b467-f63d-4ac3-b088-7d5158757769 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:57.783960 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5219b467-f63d-4ac3-b088-7d5158757769 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:57.794090 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5219b467-f63d-4ac3-b088-7d5158757769 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:57.794734 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5219b467-f63d-4ac3-b088-7d5158757769 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:57.795330 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5219b467-f63d-4ac3-b088-7d5158757769 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:57.796512 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5219b467-f63d-4ac3-b088-7d5158757769 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:57.797230 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5219b467-f63d-4ac3-b088-7d5158757769 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:57.797803 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5219b467-f63d-4ac3-b088-7d5158757769 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:57.803065 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:57.836896 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-55aa02f7-2a1d-4ccd-9a2a-76c4f32f5cb5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:57.836896 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-55aa02f7-2a1d-4ccd-9a2a-76c4f32f5cb5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:57.837244 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5219b467-f63d-4ac3-b088-7d5158757769 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062506 Aug 24 09:03:57.837244 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 444/904] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:03:57 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:57.913260 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-55aa02f7-2a1d-4ccd-9a2a-76c4f32f5cb5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:57.922140 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-55aa02f7-2a1d-4ccd-9a2a-76c4f32f5cb5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:57.924110 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-55aa02f7-2a1d-4ccd-9a2a-76c4f32f5cb5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:57.925416 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-55aa02f7-2a1d-4ccd-9a2a-76c4f32f5cb5 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1282 microversion: 2.20 time: 0.102057 Aug 24 09:03:57.925985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 461/905] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:57 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:03:58.338166 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a2a05262-b68c-4db1-9ebc-af13fc924a2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:58.338770 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a2a05262-b68c-4db1-9ebc-af13fc924a2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:58.345556 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a2a05262-b68c-4db1-9ebc-af13fc924a2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:58.346092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a2a05262-b68c-4db1-9ebc-af13fc924a2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:58.346527 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a2a05262-b68c-4db1-9ebc-af13fc924a2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:58.347229 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a2a05262-b68c-4db1-9ebc-af13fc924a2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:58.347700 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a2a05262-b68c-4db1-9ebc-af13fc924a2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:58.348121 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a2a05262-b68c-4db1-9ebc-af13fc924a2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:58.500343 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a2a05262-b68c-4db1-9ebc-af13fc924a2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:58.509335 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a2a05262-b68c-4db1-9ebc-af13fc924a2d tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1755 microversion: 2.1 time: 0.174938 Aug 24 09:03:58.511687 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 445/906] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:58 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:58.847389 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ccfa7555-0359-4613-a73d-a96e85887a38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:58.849785 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ccfa7555-0359-4613-a73d-a96e85887a38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:58.857099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ccfa7555-0359-4613-a73d-a96e85887a38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:58.857625 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ccfa7555-0359-4613-a73d-a96e85887a38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:58.858073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ccfa7555-0359-4613-a73d-a96e85887a38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:58.858836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ccfa7555-0359-4613-a73d-a96e85887a38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:58.859497 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ccfa7555-0359-4613-a73d-a96e85887a38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:58.860094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ccfa7555-0359-4613-a73d-a96e85887a38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:58.893463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ccfa7555-0359-4613-a73d-a96e85887a38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049927 Aug 24 09:03:58.894240 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 462/907] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:03:58 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:58.950726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3bb35662-a843-43e2-abd7-8814696cb4ae tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:58.951577 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3bb35662-a843-43e2-abd7-8814696cb4ae tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:59.007244 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3bb35662-a843-43e2-abd7-8814696cb4ae tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:59.015732 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3bb35662-a843-43e2-abd7-8814696cb4ae tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:59.017256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3bb35662-a843-43e2-abd7-8814696cb4ae tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:59.022890 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3bb35662-a843-43e2-abd7-8814696cb4ae tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1282 microversion: 2.20 time: 0.073275 Aug 24 09:03:59.022890 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 446/908] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:58 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:03:59.533305 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-11abe210-ab51-403d-8594-ff56c4cab501 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:59.533902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-11abe210-ab51-403d-8594-ff56c4cab501 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:59.540838 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11abe210-ab51-403d-8594-ff56c4cab501 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:59.541351 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11abe210-ab51-403d-8594-ff56c4cab501 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:59.541835 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11abe210-ab51-403d-8594-ff56c4cab501 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:59.542672 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11abe210-ab51-403d-8594-ff56c4cab501 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:59.543177 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11abe210-ab51-403d-8594-ff56c4cab501 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:59.543610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11abe210-ab51-403d-8594-ff56c4cab501 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:59.548037 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:59.698482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-11abe210-ab51-403d-8594-ff56c4cab501 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:59.707123 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-11abe210-ab51-403d-8594-ff56c4cab501 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1755 microversion: 2.1 time: 0.178110 Aug 24 09:03:59.707702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 463/909] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:59 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:59.906388 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0462affb-7483-48c6-8f10-64e9e0c51d24 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:59.908856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0462affb-7483-48c6-8f10-64e9e0c51d24 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:59.916445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0462affb-7483-48c6-8f10-64e9e0c51d24 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:59.916959 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0462affb-7483-48c6-8f10-64e9e0c51d24 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:59.917388 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0462affb-7483-48c6-8f10-64e9e0c51d24 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:59.918088 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0462affb-7483-48c6-8f10-64e9e0c51d24 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:59.918533 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0462affb-7483-48c6-8f10-64e9e0c51d24 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:59.918950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0462affb-7483-48c6-8f10-64e9e0c51d24 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:59.950549 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0462affb-7483-48c6-8f10-64e9e0c51d24 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048063 Aug 24 09:03:59.951122 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 447/910] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:03:59 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:04:00.042602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e106ce32-eb41-4db2-a081-4a7ccea23127 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:00.043190 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e106ce32-eb41-4db2-a081-4a7ccea23127 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:00.044625 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-bd364235-0c83-4860-918a-952344b07812 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:00.045131 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-bd364235-0c83-4860-918a-952344b07812 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:00.051781 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bd364235-0c83-4860-918a-952344b07812 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:00.052271 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bd364235-0c83-4860-918a-952344b07812 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:00.052748 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bd364235-0c83-4860-918a-952344b07812 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:00.053497 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bd364235-0c83-4860-918a-952344b07812 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:00.053948 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bd364235-0c83-4860-918a-952344b07812 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:00.054371 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bd364235-0c83-4860-918a-952344b07812 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:00.080880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-bd364235-0c83-4860-918a-952344b07812 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Going to try to terminate instance {{(pid=132985) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:04:00.105062 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e106ce32-eb41-4db2-a081-4a7ccea23127 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:00.113676 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e106ce32-eb41-4db2-a081-4a7ccea23127 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:00.115242 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e106ce32-eb41-4db2-a081-4a7ccea23127 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:00.116403 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e106ce32-eb41-4db2-a081-4a7ccea23127 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1282 microversion: 2.20 time: 0.078411 Aug 24 09:04:00.116995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 464/911] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:00 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1282 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:00.446711 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-bd364235-0c83-4860-918a-952344b07812 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 204 len: 0 microversion: 2.1 time: 0.405838 Aug 24 09:04:00.447324 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 448/912] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:04:00 2022] DELETE /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 09:04:00.455673 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-135890df-cd5c-4b4e-87ec-25e578fc8776 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:00.456278 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-135890df-cd5c-4b4e-87ec-25e578fc8776 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:00.463944 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-135890df-cd5c-4b4e-87ec-25e578fc8776 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:00.464423 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-135890df-cd5c-4b4e-87ec-25e578fc8776 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:00.470376 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-135890df-cd5c-4b4e-87ec-25e578fc8776 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:00.470376 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-135890df-cd5c-4b4e-87ec-25e578fc8776 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:00.470376 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-135890df-cd5c-4b4e-87ec-25e578fc8776 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:00.470376 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-135890df-cd5c-4b4e-87ec-25e578fc8776 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:00.610346 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-135890df-cd5c-4b4e-87ec-25e578fc8776 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:00.618534 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-135890df-cd5c-4b4e-87ec-25e578fc8776 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1690 microversion: 2.1 time: 0.166909 Aug 24 09:04:00.619129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 465/913] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:00 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:00.730563 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-dcfe7e13-ac22-4e6f-9086-0201445aa240 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:00.731414 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-dcfe7e13-ac22-4e6f-9086-0201445aa240 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:00.737687 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dcfe7e13-ac22-4e6f-9086-0201445aa240 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:00.738168 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dcfe7e13-ac22-4e6f-9086-0201445aa240 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:00.738596 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dcfe7e13-ac22-4e6f-9086-0201445aa240 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:00.739289 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dcfe7e13-ac22-4e6f-9086-0201445aa240 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:00.739732 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dcfe7e13-ac22-4e6f-9086-0201445aa240 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:00.740234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dcfe7e13-ac22-4e6f-9086-0201445aa240 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:00.903534 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-dcfe7e13-ac22-4e6f-9086-0201445aa240 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:00.918720 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-dcfe7e13-ac22-4e6f-9086-0201445aa240 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1758 microversion: 2.1 time: 0.192717 Aug 24 09:04:00.919739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 449/914] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:00 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:01.140661 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7f0b8bb8-9c6d-49ed-9028-eb4414fb1dfa tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:01.142244 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7f0b8bb8-9c6d-49ed-9028-eb4414fb1dfa tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:01.149420 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7f0b8bb8-9c6d-49ed-9028-eb4414fb1dfa tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:01.149903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7f0b8bb8-9c6d-49ed-9028-eb4414fb1dfa tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:01.150350 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7f0b8bb8-9c6d-49ed-9028-eb4414fb1dfa tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:01.151035 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7f0b8bb8-9c6d-49ed-9028-eb4414fb1dfa tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:01.151482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7f0b8bb8-9c6d-49ed-9028-eb4414fb1dfa tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:01.151898 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7f0b8bb8-9c6d-49ed-9028-eb4414fb1dfa tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:01.223915 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7f0b8bb8-9c6d-49ed-9028-eb4414fb1dfa tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:01.236590 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7f0b8bb8-9c6d-49ed-9028-eb4414fb1dfa tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:01.239534 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7f0b8bb8-9c6d-49ed-9028-eb4414fb1dfa tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:01.241659 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7f0b8bb8-9c6d-49ed-9028-eb4414fb1dfa tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1286 microversion: 2.20 time: 0.104701 Aug 24 09:04:01.242687 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 466/915] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:01 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:01.640296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-31382b23-28b1-44c7-b5b0-616455f78f36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:01.641330 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-31382b23-28b1-44c7-b5b0-616455f78f36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:01.648637 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31382b23-28b1-44c7-b5b0-616455f78f36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:01.649606 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31382b23-28b1-44c7-b5b0-616455f78f36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:01.650050 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31382b23-28b1-44c7-b5b0-616455f78f36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:01.650767 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31382b23-28b1-44c7-b5b0-616455f78f36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:01.651221 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31382b23-28b1-44c7-b5b0-616455f78f36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:01.651635 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-31382b23-28b1-44c7-b5b0-616455f78f36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:01.803537 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-31382b23-28b1-44c7-b5b0-616455f78f36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:01.811989 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-31382b23-28b1-44c7-b5b0-616455f78f36 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1690 microversion: 2.1 time: 0.175582 Aug 24 09:04:01.812593 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 450/916] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:01 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:02.266301 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5db722aa-f367-48a4-954e-6aa0b253225c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:02.266903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5db722aa-f367-48a4-954e-6aa0b253225c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:02.273540 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5db722aa-f367-48a4-954e-6aa0b253225c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:02.274021 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5db722aa-f367-48a4-954e-6aa0b253225c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:02.274452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5db722aa-f367-48a4-954e-6aa0b253225c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:02.275156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5db722aa-f367-48a4-954e-6aa0b253225c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:02.275604 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5db722aa-f367-48a4-954e-6aa0b253225c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:02.276043 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5db722aa-f367-48a4-954e-6aa0b253225c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:02.344942 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5db722aa-f367-48a4-954e-6aa0b253225c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:02.353787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5db722aa-f367-48a4-954e-6aa0b253225c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:02.355470 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5db722aa-f367-48a4-954e-6aa0b253225c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:02.356644 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5db722aa-f367-48a4-954e-6aa0b253225c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1286 microversion: 2.20 time: 0.094543 Aug 24 09:04:02.357420 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 467/917] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:02 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:02.847820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b9aa2b79-ddec-4b6b-a3d2-c6ca3ca31670 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:02.848409 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b9aa2b79-ddec-4b6b-a3d2-c6ca3ca31670 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:02.855803 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b9aa2b79-ddec-4b6b-a3d2-c6ca3ca31670 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:02.856294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b9aa2b79-ddec-4b6b-a3d2-c6ca3ca31670 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:02.856763 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b9aa2b79-ddec-4b6b-a3d2-c6ca3ca31670 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:02.857461 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b9aa2b79-ddec-4b6b-a3d2-c6ca3ca31670 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:02.857909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b9aa2b79-ddec-4b6b-a3d2-c6ca3ca31670 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:02.858330 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b9aa2b79-ddec-4b6b-a3d2-c6ca3ca31670 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:02.998578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b9aa2b79-ddec-4b6b-a3d2-c6ca3ca31670 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:03.006973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b9aa2b79-ddec-4b6b-a3d2-c6ca3ca31670 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1690 microversion: 2.1 time: 0.162845 Aug 24 09:04:03.007446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 451/918] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:02 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:03.382568 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a6dcdfb4-a3ca-4b76-b549-1e96ac6d36ff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:03.383203 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a6dcdfb4-a3ca-4b76-b549-1e96ac6d36ff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:03.390745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a6dcdfb4-a3ca-4b76-b549-1e96ac6d36ff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:03.391226 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a6dcdfb4-a3ca-4b76-b549-1e96ac6d36ff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:03.391704 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a6dcdfb4-a3ca-4b76-b549-1e96ac6d36ff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:03.392402 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a6dcdfb4-a3ca-4b76-b549-1e96ac6d36ff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:03.393074 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a6dcdfb4-a3ca-4b76-b549-1e96ac6d36ff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:03.394001 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a6dcdfb4-a3ca-4b76-b549-1e96ac6d36ff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:03.466419 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a6dcdfb4-a3ca-4b76-b549-1e96ac6d36ff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:03.475259 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a6dcdfb4-a3ca-4b76-b549-1e96ac6d36ff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:03.476987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a6dcdfb4-a3ca-4b76-b549-1e96ac6d36ff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:03.478372 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a6dcdfb4-a3ca-4b76-b549-1e96ac6d36ff tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1286 microversion: 2.20 time: 0.100316 Aug 24 09:04:03.479072 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 468/919] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:03 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:04.028486 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-319e4e2e-e909-4d15-8e2b-c8c709198583 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:04.029224 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-319e4e2e-e909-4d15-8e2b-c8c709198583 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:04.039240 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-319e4e2e-e909-4d15-8e2b-c8c709198583 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:04.039868 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-319e4e2e-e909-4d15-8e2b-c8c709198583 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:04.040312 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-319e4e2e-e909-4d15-8e2b-c8c709198583 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:04.041339 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-319e4e2e-e909-4d15-8e2b-c8c709198583 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:04.041990 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-319e4e2e-e909-4d15-8e2b-c8c709198583 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:04.042605 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-319e4e2e-e909-4d15-8e2b-c8c709198583 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:04.284165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-319e4e2e-e909-4d15-8e2b-c8c709198583 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:04.296037 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-319e4e2e-e909-4d15-8e2b-c8c709198583 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1690 microversion: 2.1 time: 0.271806 Aug 24 09:04:04.296643 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 452/920] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:04 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1690 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:04.501185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-69ccd0f8-760a-46a2-945d-ab1c6649ea00 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:04.502387 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-69ccd0f8-760a-46a2-945d-ab1c6649ea00 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:04.509567 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-69ccd0f8-760a-46a2-945d-ab1c6649ea00 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:04.510171 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-69ccd0f8-760a-46a2-945d-ab1c6649ea00 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:04.510679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-69ccd0f8-760a-46a2-945d-ab1c6649ea00 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:04.511458 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-69ccd0f8-760a-46a2-945d-ab1c6649ea00 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:04.512055 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-69ccd0f8-760a-46a2-945d-ab1c6649ea00 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:04.512560 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-69ccd0f8-760a-46a2-945d-ab1c6649ea00 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:04.583577 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-69ccd0f8-760a-46a2-945d-ab1c6649ea00 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:04.592928 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-69ccd0f8-760a-46a2-945d-ab1c6649ea00 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:04.594472 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-69ccd0f8-760a-46a2-945d-ab1c6649ea00 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:04.595601 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-69ccd0f8-760a-46a2-945d-ab1c6649ea00 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1334 microversion: 2.20 time: 0.098319 Aug 24 09:04:04.596194 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 469/921] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:04 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:04.801696 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-4cac70d3-a120-4449-80aa-092fdfd0d115 req-c7da7f69-4128-41c4-bc67-8296f729e57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2342ef6-1538-4ed8-a880-4592faa068f5", "name": "network-vif-deleted", "tag": "24078fe7-6b72-4110-8f91-0468c482387e"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:04.818302 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-4cac70d3-a120-4449-80aa-092fdfd0d115 req-c7da7f69-4128-41c4-bc67-8296f729e57d service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:04.819993 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-4cac70d3-a120-4449-80aa-092fdfd0d115 req-c7da7f69-4128-41c4-bc67-8296f729e57d service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:04.820516 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-4cac70d3-a120-4449-80aa-092fdfd0d115 req-c7da7f69-4128-41c4-bc67-8296f729e57d service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:04.834762 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-4cac70d3-a120-4449-80aa-092fdfd0d115 req-c7da7f69-4128-41c4-bc67-8296f729e57d service nova] Creating event network-vif-deleted:24078fe7-6b72-4110-8f91-0468c482387e for instance b2342ef6-1538-4ed8-a880-4592faa068f5 on hv-cinder-85221 Aug 24 09:04:04.839726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-4cac70d3-a120-4449-80aa-092fdfd0d115 req-c7da7f69-4128-41c4-bc67-8296f729e57d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041881 Aug 24 09:04:04.840322 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 453/922] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:05.318361 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:05.319315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:05.326574 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:05.327064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:05.327501 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:05.328213 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:05.329333 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:05.329958 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:05.363254 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:05.363254 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:05.363254 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:05.363704 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lazy-loading 'fault' on Instance uuid b2342ef6-1538-4ed8-a880-4592faa068f5 {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:04:05.411713 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:05.421416 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d606dac5-40bb-4572-8386-b4ef6daa1f49 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 200 len: 1335 microversion: 2.1 time: 0.106841 Aug 24 09:04:05.426529 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 470/923] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:05 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 1335 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:05.620758 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c248383a-5741-45e8-b9fd-b49b2a1d8802 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:05.621537 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c248383a-5741-45e8-b9fd-b49b2a1d8802 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:05.628447 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c248383a-5741-45e8-b9fd-b49b2a1d8802 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:05.628964 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c248383a-5741-45e8-b9fd-b49b2a1d8802 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:05.629420 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c248383a-5741-45e8-b9fd-b49b2a1d8802 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:05.630218 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c248383a-5741-45e8-b9fd-b49b2a1d8802 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:05.630851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c248383a-5741-45e8-b9fd-b49b2a1d8802 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:05.631457 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c248383a-5741-45e8-b9fd-b49b2a1d8802 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:05.714616 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c248383a-5741-45e8-b9fd-b49b2a1d8802 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:05.722705 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c248383a-5741-45e8-b9fd-b49b2a1d8802 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:05.724881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c248383a-5741-45e8-b9fd-b49b2a1d8802 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:05.726223 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c248383a-5741-45e8-b9fd-b49b2a1d8802 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1340 microversion: 2.20 time: 0.110448 Aug 24 09:04:05.742208 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 454/924] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:05 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1340 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:06.452844 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b42379b7-30d8-4d03-92e4-aa4bca385c38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:06.453592 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b42379b7-30d8-4d03-92e4-aa4bca385c38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: b2342ef6-1538-4ed8-a880-4592faa068f5] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:06.459977 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b42379b7-30d8-4d03-92e4-aa4bca385c38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:06.461364 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b42379b7-30d8-4d03-92e4-aa4bca385c38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:06.462499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b42379b7-30d8-4d03-92e4-aa4bca385c38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:06.463259 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b42379b7-30d8-4d03-92e4-aa4bca385c38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:06.463715 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b42379b7-30d8-4d03-92e4-aa4bca385c38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:06.464144 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b42379b7-30d8-4d03-92e4-aa4bca385c38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:06.479185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-b42379b7-30d8-4d03-92e4-aa4bca385c38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] HTTP exception thrown: Instance b2342ef6-1538-4ed8-a880-4592faa068f5 could not be found. Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b42379b7-30d8-4d03-92e4-aa4bca385c38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Request method failure captured: Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 HTTP/1.1 Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeVV9ImGTcRNmY4Hiln2vQcRMqL4RxwwQ_WIqLficzvTIx6Pz-RaHxnTth4Y2xKprHubC8bVxL5vpe6TejrqAfQJBa3lTvoqG4hzNbj0JnvBpSGphO-iVUfO5vGv_7r-6agc6A0AMKeemM4c2BBHlfPzWGZS8w3it_iG6hNJDNrWJE Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: c966c27f100846ca8cf06122ddc8c408 Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:04:06.481197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:04:06.483993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c966c27f100846ca8cf06122ddc8c408", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:04:06.483993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 09:04:06.483993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: c966c27f100846ca8cf06122ddc8c408 Aug 24 09:04:06.483993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 09:04:06.483993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-ServerRescueNegativeTestJSON-509348674-project Aug 24 09:04:06.483993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:04:06.483993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:04:06.483993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: f56524e822e641bc9bb11eddfe27f85d Aug 24 09:04:06.483993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-ServerRescueNegativeTestJSON-509348674-project Aug 24 09:04:06.483993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:04:06.483993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance b2342ef6-1538-4ed8-a880-4592faa068f5 could not be found. Aug 24 09:04:06.483993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': 'b2342ef6-1538-4ed8-a880-4592faa068f5'} Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2342ef6-1538-4ed8-a880-4592faa068f5 could not be found. Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:04:06.485183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2342ef6-1538-4ed8-a880-4592faa068f5 could not be found. Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2342ef6-1538-4ed8-a880-4592faa068f5 could not be found. Aug 24 09:04:06.486983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:06.488518 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b42379b7-30d8-4d03-92e4-aa4bca385c38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Returning 404 to user: Instance b2342ef6-1538-4ed8-a880-4592faa068f5 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:04:06.488518 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b42379b7-30d8-4d03-92e4-aa4bca385c38 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5" status: 404 len: 111 microversion: 2.1 time: 0.035619 Aug 24 09:04:06.488518 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 471/925] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:06 2022] GET /compute/v2.1/servers/b2342ef6-1538-4ed8-a880-4592faa068f5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:04:06.491885 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-81e14838-f09b-49cf-bd52-58549f4ada2b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '.version_select at 0x7f16b2c8f0d0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:06.570223 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:06.590888 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-81e14838-f09b-49cf-bd52-58549f4ada2b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-618136394" status: 202 len: 0 microversion: 2.1 time: 0.102705 Aug 24 09:04:06.591621 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 455/926] 10.222.0.55 () {58 vars in 1218 bytes} [Wed Aug 24 09:04:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-618136394 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 09:04:06.751645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4d7aad60-fb3e-4a65-9113-c4eacf43b1f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:06.752256 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4d7aad60-fb3e-4a65-9113-c4eacf43b1f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:06.759020 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4d7aad60-fb3e-4a65-9113-c4eacf43b1f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:06.759460 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4d7aad60-fb3e-4a65-9113-c4eacf43b1f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:06.759895 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4d7aad60-fb3e-4a65-9113-c4eacf43b1f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:06.760611 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4d7aad60-fb3e-4a65-9113-c4eacf43b1f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:06.761071 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4d7aad60-fb3e-4a65-9113-c4eacf43b1f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:06.761495 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4d7aad60-fb3e-4a65-9113-c4eacf43b1f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:06.966184 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4d7aad60-fb3e-4a65-9113-c4eacf43b1f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:06.976680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4d7aad60-fb3e-4a65-9113-c4eacf43b1f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:06.978348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4d7aad60-fb3e-4a65-9113-c4eacf43b1f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:06.979570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4d7aad60-fb3e-4a65-9113-c4eacf43b1f2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1408 microversion: 2.20 time: 0.232075 Aug 24 09:04:06.980852 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 472/927] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:06 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:07.165741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-61e258b8-33b5-41d0-904b-d7de512d6e73 req-e4342da5-94a4-4bf1-8cc7-082347c43149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97fe50f9-e517-4e9a-80b5-6faba0b9f10a", "tag": "8d40ee89-fb81-4d38-99c2-3dac67fab1b0"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:07.180961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-61e258b8-33b5-41d0-904b-d7de512d6e73 req-e4342da5-94a4-4bf1-8cc7-082347c43149 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:07.181453 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-61e258b8-33b5-41d0-904b-d7de512d6e73 req-e4342da5-94a4-4bf1-8cc7-082347c43149 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:07.182131 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-61e258b8-33b5-41d0-904b-d7de512d6e73 req-e4342da5-94a4-4bf1-8cc7-082347c43149 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:07.202879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-61e258b8-33b5-41d0-904b-d7de512d6e73 req-e4342da5-94a4-4bf1-8cc7-082347c43149 service nova] Creating event network-changed:8d40ee89-fb81-4d38-99c2-3dac67fab1b0 for instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a on hv-cinder-85221 Aug 24 09:04:07.208488 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-61e258b8-33b5-41d0-904b-d7de512d6e73 req-e4342da5-94a4-4bf1-8cc7-082347c43149 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047146 Aug 24 09:04:07.209379 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 456/928] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:08.003342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-43d5736f-4ce6-4eaa-974e-dee658bd1c32 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:08.003954 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-43d5736f-4ce6-4eaa-974e-dee658bd1c32 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:08.011249 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-43d5736f-4ce6-4eaa-974e-dee658bd1c32 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:08.011722 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-43d5736f-4ce6-4eaa-974e-dee658bd1c32 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:08.012147 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-43d5736f-4ce6-4eaa-974e-dee658bd1c32 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:08.012868 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-43d5736f-4ce6-4eaa-974e-dee658bd1c32 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:08.013429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-43d5736f-4ce6-4eaa-974e-dee658bd1c32 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:08.013855 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-43d5736f-4ce6-4eaa-974e-dee658bd1c32 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:08.150782 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-43d5736f-4ce6-4eaa-974e-dee658bd1c32 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:08.159604 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-43d5736f-4ce6-4eaa-974e-dee658bd1c32 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:08.161164 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-43d5736f-4ce6-4eaa-974e-dee658bd1c32 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:08.162296 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-43d5736f-4ce6-4eaa-974e-dee658bd1c32 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1408 microversion: 2.20 time: 0.162915 Aug 24 09:04:08.162853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 473/929] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:07 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:09.186793 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3fc5c614-fe12-4dcd-ab03-f487937847e0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:09.187499 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3fc5c614-fe12-4dcd-ab03-f487937847e0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:09.190157 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=12 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:09.195493 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3fc5c614-fe12-4dcd-ab03-f487937847e0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:09.195982 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3fc5c614-fe12-4dcd-ab03-f487937847e0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:09.196412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3fc5c614-fe12-4dcd-ab03-f487937847e0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:09.197150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3fc5c614-fe12-4dcd-ab03-f487937847e0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:09.197629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3fc5c614-fe12-4dcd-ab03-f487937847e0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:09.201303 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3fc5c614-fe12-4dcd-ab03-f487937847e0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:09.344964 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3fc5c614-fe12-4dcd-ab03-f487937847e0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:09.353420 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3fc5c614-fe12-4dcd-ab03-f487937847e0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:09.354928 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3fc5c614-fe12-4dcd-ab03-f487937847e0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:09.356040 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3fc5c614-fe12-4dcd-ab03-f487937847e0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1408 microversion: 2.20 time: 0.173889 Aug 24 09:04:09.356609 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 457/930] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:09 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:10.063297 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-52052716-964a-458f-9b47-a95c76dc091e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:10.063844 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-52052716-964a-458f-9b47-a95c76dc091e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:10.070429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-52052716-964a-458f-9b47-a95c76dc091e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:10.071651 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-52052716-964a-458f-9b47-a95c76dc091e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:10.072094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-52052716-964a-458f-9b47-a95c76dc091e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:10.072837 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-52052716-964a-458f-9b47-a95c76dc091e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:10.073320 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-52052716-964a-458f-9b47-a95c76dc091e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:10.073743 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-52052716-964a-458f-9b47-a95c76dc091e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:10.100710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-52052716-964a-458f-9b47-a95c76dc091e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Going to try to terminate instance {{(pid=132984) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:04:10.115004 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=6 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:10.378554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fdccdeff-c4ec-486a-a242-32b153745155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:10.379232 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-fdccdeff-c4ec-486a-a242-32b153745155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:10.385817 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdccdeff-c4ec-486a-a242-32b153745155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:10.386302 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdccdeff-c4ec-486a-a242-32b153745155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:10.386735 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdccdeff-c4ec-486a-a242-32b153745155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:10.387425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdccdeff-c4ec-486a-a242-32b153745155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:10.387882 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdccdeff-c4ec-486a-a242-32b153745155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:10.388296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdccdeff-c4ec-486a-a242-32b153745155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:10.422861 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-52052716-964a-458f-9b47-a95c76dc091e tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "DELETE /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 204 len: 0 microversion: 2.1 time: 0.363103 Aug 24 09:04:10.423477 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 474/931] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:04:10 2022] DELETE /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:04:10.432419 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-949cce3d-5467-45d5-9d73-770374ef85a5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:10.433193 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-949cce3d-5467-45d5-9d73-770374ef85a5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:10.439341 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-949cce3d-5467-45d5-9d73-770374ef85a5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:10.439828 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-949cce3d-5467-45d5-9d73-770374ef85a5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:10.440303 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-949cce3d-5467-45d5-9d73-770374ef85a5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:10.441104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-949cce3d-5467-45d5-9d73-770374ef85a5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:10.447764 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-949cce3d-5467-45d5-9d73-770374ef85a5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:10.447764 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-949cce3d-5467-45d5-9d73-770374ef85a5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:10.535249 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fdccdeff-c4ec-486a-a242-32b153745155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:10.545457 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fdccdeff-c4ec-486a-a242-32b153745155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:10.547494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fdccdeff-c4ec-486a-a242-32b153745155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:10.548867 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fdccdeff-c4ec-486a-a242-32b153745155 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1408 microversion: 2.20 time: 0.174241 Aug 24 09:04:10.549427 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 458/932] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:10 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:04:10.580496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-949cce3d-5467-45d5-9d73-770374ef85a5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:10.589034 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-949cce3d-5467-45d5-9d73-770374ef85a5 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1508 microversion: 2.1 time: 0.161306 Aug 24 09:04:10.589612 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 475/933] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:10 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:11.259923 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e98d5ef4-5f64-463f-9295-a1dd3e0cc340 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:11.260645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e98d5ef4-5f64-463f-9295-a1dd3e0cc340 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:11.267186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e98d5ef4-5f64-463f-9295-a1dd3e0cc340 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:11.267827 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e98d5ef4-5f64-463f-9295-a1dd3e0cc340 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:11.268313 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e98d5ef4-5f64-463f-9295-a1dd3e0cc340 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:11.269246 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e98d5ef4-5f64-463f-9295-a1dd3e0cc340 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:11.269855 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e98d5ef4-5f64-463f-9295-a1dd3e0cc340 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:11.270428 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e98d5ef4-5f64-463f-9295-a1dd3e0cc340 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:11.299215 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e98d5ef4-5f64-463f-9295-a1dd3e0cc340 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Going to try to terminate instance {{(pid=132985) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:04:11.573027 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ad3ee357-8393-409f-ab3a-87a28758d695 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:11.575127 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ad3ee357-8393-409f-ab3a-87a28758d695 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:11.581275 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ad3ee357-8393-409f-ab3a-87a28758d695 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:11.581772 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ad3ee357-8393-409f-ab3a-87a28758d695 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:11.582218 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ad3ee357-8393-409f-ab3a-87a28758d695 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:11.582931 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ad3ee357-8393-409f-ab3a-87a28758d695 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:11.583389 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ad3ee357-8393-409f-ab3a-87a28758d695 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:11.583819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ad3ee357-8393-409f-ab3a-87a28758d695 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:11.635214 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e98d5ef4-5f64-463f-9295-a1dd3e0cc340 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "DELETE /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 204 len: 0 microversion: 2.1 time: 0.379447 Aug 24 09:04:11.636068 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 459/934] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:04:11 2022] DELETE /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:04:11.642908 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-156f9cca-a793-414f-899e-1399c7ba19a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:11.647189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-156f9cca-a793-414f-899e-1399c7ba19a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:11.653534 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-156f9cca-a793-414f-899e-1399c7ba19a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:11.654414 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-156f9cca-a793-414f-899e-1399c7ba19a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:11.655187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-156f9cca-a793-414f-899e-1399c7ba19a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:11.656411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-156f9cca-a793-414f-899e-1399c7ba19a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:11.657413 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-156f9cca-a793-414f-899e-1399c7ba19a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:11.658009 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-156f9cca-a793-414f-899e-1399c7ba19a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:11.750150 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ad3ee357-8393-409f-ab3a-87a28758d695 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:11.759548 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ad3ee357-8393-409f-ab3a-87a28758d695 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:11.761138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ad3ee357-8393-409f-ab3a-87a28758d695 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:11.762891 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ad3ee357-8393-409f-ab3a-87a28758d695 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1408 microversion: 2.20 time: 0.194506 Aug 24 09:04:11.765211 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 476/935] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:11 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:04:11.781022 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ca84e49a-0ec6-46a4-8d6c-5f51820ae949 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:11.782164 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ca84e49a-0ec6-46a4-8d6c-5f51820ae949 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:11.790540 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ca84e49a-0ec6-46a4-8d6c-5f51820ae949 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:11.791163 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ca84e49a-0ec6-46a4-8d6c-5f51820ae949 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:11.791738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ca84e49a-0ec6-46a4-8d6c-5f51820ae949 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:11.792714 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ca84e49a-0ec6-46a4-8d6c-5f51820ae949 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:11.793265 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ca84e49a-0ec6-46a4-8d6c-5f51820ae949 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:11.793800 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ca84e49a-0ec6-46a4-8d6c-5f51820ae949 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:11.843280 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-156f9cca-a793-414f-899e-1399c7ba19a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:11.847169 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:11.853083 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-156f9cca-a793-414f-899e-1399c7ba19a7 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1508 microversion: 2.1 time: 0.215767 Aug 24 09:04:11.853666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 460/936] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:11 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:11.936524 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ca84e49a-0ec6-46a4-8d6c-5f51820ae949 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:11.944793 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ca84e49a-0ec6-46a4-8d6c-5f51820ae949 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1577 microversion: 2.1 time: 0.177318 Aug 24 09:04:11.945396 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 477/937] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:11 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:12.786727 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7cf19148-f220-4468-917b-4b5801d3b9c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:12.787489 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-7cf19148-f220-4468-917b-4b5801d3b9c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:12.794989 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7cf19148-f220-4468-917b-4b5801d3b9c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:12.795464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7cf19148-f220-4468-917b-4b5801d3b9c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:12.795897 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7cf19148-f220-4468-917b-4b5801d3b9c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:12.796627 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7cf19148-f220-4468-917b-4b5801d3b9c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:12.797073 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7cf19148-f220-4468-917b-4b5801d3b9c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:12.797485 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7cf19148-f220-4468-917b-4b5801d3b9c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:12.883897 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a4369adb-d54c-4f57-93bb-ac0ee6ca2c26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:12.884526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a4369adb-d54c-4f57-93bb-ac0ee6ca2c26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:12.891526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a4369adb-d54c-4f57-93bb-ac0ee6ca2c26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:12.892043 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a4369adb-d54c-4f57-93bb-ac0ee6ca2c26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:12.892443 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a4369adb-d54c-4f57-93bb-ac0ee6ca2c26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:12.893267 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a4369adb-d54c-4f57-93bb-ac0ee6ca2c26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:12.893609 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a4369adb-d54c-4f57-93bb-ac0ee6ca2c26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:12.894038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a4369adb-d54c-4f57-93bb-ac0ee6ca2c26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:12.953465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7cf19148-f220-4468-917b-4b5801d3b9c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:12.962842 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7cf19148-f220-4468-917b-4b5801d3b9c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:12.964377 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7cf19148-f220-4468-917b-4b5801d3b9c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:12.965551 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7cf19148-f220-4468-917b-4b5801d3b9c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1408 microversion: 2.20 time: 0.182848 Aug 24 09:04:12.966123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 461/938] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:12 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:12.971158 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a1b13799-ec1e-4705-86ae-bee638d01a0c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:12.982343 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a1b13799-ec1e-4705-86ae-bee638d01a0c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:12.982343 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1b13799-ec1e-4705-86ae-bee638d01a0c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:12.982343 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1b13799-ec1e-4705-86ae-bee638d01a0c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:12.983060 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1b13799-ec1e-4705-86ae-bee638d01a0c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:12.984076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1b13799-ec1e-4705-86ae-bee638d01a0c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:12.985636 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1b13799-ec1e-4705-86ae-bee638d01a0c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:12.986067 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1b13799-ec1e-4705-86ae-bee638d01a0c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:13.058665 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:04:13.059291 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Wed Aug 24 09:04:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 (ip 10.222.0.55) !!! Aug 24 09:04:13.085996 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a4369adb-d54c-4f57-93bb-ac0ee6ca2c26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:13.094253 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a4369adb-d54c-4f57-93bb-ac0ee6ca2c26 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1508 microversion: 2.1 time: 0.214807 Aug 24 09:04:13.094847 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 478/939] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:12 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1508 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:13.154946 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a1b13799-ec1e-4705-86ae-bee638d01a0c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:13.167913 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a1b13799-ec1e-4705-86ae-bee638d01a0c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1577 microversion: 2.1 time: 0.200262 Aug 24 09:04:13.169014 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 462/940] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:12 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1577 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:13.988682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2139d935-3ba9-4131-9fbc-15d41404e740 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:13.989385 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2139d935-3ba9-4131-9fbc-15d41404e740 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:13.996327 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2139d935-3ba9-4131-9fbc-15d41404e740 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:13.996872 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2139d935-3ba9-4131-9fbc-15d41404e740 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:13.997314 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2139d935-3ba9-4131-9fbc-15d41404e740 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:13.998029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2139d935-3ba9-4131-9fbc-15d41404e740 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:13.998488 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2139d935-3ba9-4131-9fbc-15d41404e740 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:13.998920 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2139d935-3ba9-4131-9fbc-15d41404e740 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:14.019651 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:14.115851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6f255f18-9253-433c-b924-e04bd354f6b4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:14.116474 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6f255f18-9253-433c-b924-e04bd354f6b4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:14.123523 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6f255f18-9253-433c-b924-e04bd354f6b4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:14.124343 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6f255f18-9253-433c-b924-e04bd354f6b4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:14.124821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6f255f18-9253-433c-b924-e04bd354f6b4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:14.125539 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6f255f18-9253-433c-b924-e04bd354f6b4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:14.126003 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6f255f18-9253-433c-b924-e04bd354f6b4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:14.126424 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6f255f18-9253-433c-b924-e04bd354f6b4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:14.149816 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2139d935-3ba9-4131-9fbc-15d41404e740 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:14.164271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2139d935-3ba9-4131-9fbc-15d41404e740 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:14.166316 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2139d935-3ba9-4131-9fbc-15d41404e740 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:14.168176 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2139d935-3ba9-4131-9fbc-15d41404e740 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1408 microversion: 2.20 time: 0.183653 Aug 24 09:04:14.169029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 479/941] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:13 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:14.197564 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4ee1c6e9-8ed1-4fc5-8560-391e9ce0fbc6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:14.199286 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4ee1c6e9-8ed1-4fc5-8560-391e9ce0fbc6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:14.212466 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4ee1c6e9-8ed1-4fc5-8560-391e9ce0fbc6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:14.213358 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4ee1c6e9-8ed1-4fc5-8560-391e9ce0fbc6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:14.214135 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4ee1c6e9-8ed1-4fc5-8560-391e9ce0fbc6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:14.215170 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4ee1c6e9-8ed1-4fc5-8560-391e9ce0fbc6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:14.215751 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4ee1c6e9-8ed1-4fc5-8560-391e9ce0fbc6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:14.216285 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4ee1c6e9-8ed1-4fc5-8560-391e9ce0fbc6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:14.354526 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6f255f18-9253-433c-b924-e04bd354f6b4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:14.363530 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6f255f18-9253-433c-b924-e04bd354f6b4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1508 microversion: 2.1 time: 0.251662 Aug 24 09:04:14.364413 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 463/942] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:14 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:14.476371 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4ee1c6e9-8ed1-4fc5-8560-391e9ce0fbc6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:14.491364 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4ee1c6e9-8ed1-4fc5-8560-391e9ce0fbc6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1577 microversion: 2.1 time: 0.302487 Aug 24 09:04:14.493543 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 480/943] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:14 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1577 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:14.689908 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-ac92f4a5-b533-4d25-a492-62709d3f4e90 req-0469539c-1895-4610-93d6-5668d91b174c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91522d87-2654-4cee-9b8c-b7431ed55dd3", "name": "network-vif-deleted", "tag": "4a80d617-a0d7-4cc6-b5b2-6590c4bdea44"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:14.702350 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-ac92f4a5-b533-4d25-a492-62709d3f4e90 req-0469539c-1895-4610-93d6-5668d91b174c service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:14.703013 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-ac92f4a5-b533-4d25-a492-62709d3f4e90 req-0469539c-1895-4610-93d6-5668d91b174c service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:14.703578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-ac92f4a5-b533-4d25-a492-62709d3f4e90 req-0469539c-1895-4610-93d6-5668d91b174c service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:14.716728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-ac92f4a5-b533-4d25-a492-62709d3f4e90 req-0469539c-1895-4610-93d6-5668d91b174c service nova] Creating event network-vif-deleted:4a80d617-a0d7-4cc6-b5b2-6590c4bdea44 for instance 91522d87-2654-4cee-9b8c-b7431ed55dd3 on hv-cinder-85221 Aug 24 09:04:14.722668 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-ac92f4a5-b533-4d25-a492-62709d3f4e90 req-0469539c-1895-4610-93d6-5668d91b174c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038896 Aug 24 09:04:14.723248 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 464/944] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:15.193711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8ef03b9e-7821-486c-b95a-d2b53fadf21d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:15.194329 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8ef03b9e-7821-486c-b95a-d2b53fadf21d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:15.202315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ef03b9e-7821-486c-b95a-d2b53fadf21d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:15.202851 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ef03b9e-7821-486c-b95a-d2b53fadf21d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:15.203440 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ef03b9e-7821-486c-b95a-d2b53fadf21d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:15.204153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ef03b9e-7821-486c-b95a-d2b53fadf21d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:15.205128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ef03b9e-7821-486c-b95a-d2b53fadf21d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:15.205890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ef03b9e-7821-486c-b95a-d2b53fadf21d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:15.382760 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-8e465f01-9aeb-43e9-84b5-3675482fbc85 req-e4b435d4-3c31-4746-baab-3919aface28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fe50f9-e517-4e9a-80b5-6faba0b9f10a", "name": "network-vif-plugged", "status": "completed", "tag": "8d40ee89-fb81-4d38-99c2-3dac67fab1b0"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:15.395347 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-8e465f01-9aeb-43e9-84b5-3675482fbc85 req-e4b435d4-3c31-4746-baab-3919aface28f service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:15.395843 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-8e465f01-9aeb-43e9-84b5-3675482fbc85 req-e4b435d4-3c31-4746-baab-3919aface28f service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:15.396281 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-8e465f01-9aeb-43e9-84b5-3675482fbc85 req-e4b435d4-3c31-4746-baab-3919aface28f service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:15.410024 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-8e465f01-9aeb-43e9-84b5-3675482fbc85 req-e4b435d4-3c31-4746-baab-3919aface28f service nova] Creating event network-vif-plugged:8d40ee89-fb81-4d38-99c2-3dac67fab1b0 for instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a on hv-cinder-85221 Aug 24 09:04:15.415904 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-8e465f01-9aeb-43e9-84b5-3675482fbc85 req-e4b435d4-3c31-4746-baab-3919aface28f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037286 Aug 24 09:04:15.416531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 465/945] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:04:15.421890 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:15.422606 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:15.424670 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:15.430382 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:15.430881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:15.431324 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:15.432083 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:15.432716 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:15.433167 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:15.454604 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8ef03b9e-7821-486c-b95a-d2b53fadf21d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:15.470645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:15.471139 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:15.471623 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:15.472032 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lazy-loading 'fault' on Instance uuid 91522d87-2654-4cee-9b8c-b7431ed55dd3 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:04:15.479835 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8ef03b9e-7821-486c-b95a-d2b53fadf21d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:15.488465 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8ef03b9e-7821-486c-b95a-d2b53fadf21d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:15.497827 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8ef03b9e-7821-486c-b95a-d2b53fadf21d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1408 microversion: 2.20 time: 0.301880 Aug 24 09:04:15.519959 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 481/946] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:15 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1408 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:15.532097 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:15.548230 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-11316577-e7cf-4ac6-985d-284a245dddeb tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 200 len: 1311 microversion: 2.1 time: 0.130396 Aug 24 09:04:15.548865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 466/947] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:15 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:15.664321 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-080c0805-2a05-4cf8-8039-c090d7d137e0 req-e955ab1d-831b-4263-b684-2af40e453dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20347088-35b8-4cfe-8457-8ca131fcfa2c", "name": "network-vif-deleted", "tag": "df5ed933-769b-4275-a845-9beb266eb36d"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:15.684823 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-080c0805-2a05-4cf8-8039-c090d7d137e0 req-e955ab1d-831b-4263-b684-2af40e453dcf service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:15.686329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-080c0805-2a05-4cf8-8039-c090d7d137e0 req-e955ab1d-831b-4263-b684-2af40e453dcf service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:15.689757 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-080c0805-2a05-4cf8-8039-c090d7d137e0 req-e955ab1d-831b-4263-b684-2af40e453dcf service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:15.712205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-080c0805-2a05-4cf8-8039-c090d7d137e0 req-e955ab1d-831b-4263-b684-2af40e453dcf service nova] Creating event network-vif-deleted:df5ed933-769b-4275-a845-9beb266eb36d for instance 20347088-35b8-4cfe-8457-8ca131fcfa2c on hv-cinder-85221 Aug 24 09:04:15.720208 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-080c0805-2a05-4cf8-8039-c090d7d137e0 req-e955ab1d-831b-4263-b684-2af40e453dcf service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059344 Aug 24 09:04:15.721561 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 467/948] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:15.793512 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-246903c9-b86d-406d-a73d-4fa8b4c893a3 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:15.794394 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-246903c9-b86d-406d-a73d-4fa8b4c893a3 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:15.801511 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-246903c9-b86d-406d-a73d-4fa8b4c893a3 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:15.802292 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-246903c9-b86d-406d-a73d-4fa8b4c893a3 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:15.802754 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-246903c9-b86d-406d-a73d-4fa8b4c893a3 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:15.803813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-246903c9-b86d-406d-a73d-4fa8b4c893a3 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:15.804273 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-246903c9-b86d-406d-a73d-4fa8b4c893a3 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:15.805449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-246903c9-b86d-406d-a73d-4fa8b4c893a3 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:15.891767 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-246903c9-b86d-406d-a73d-4fa8b4c893a3 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:15.900447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-246903c9-b86d-406d-a73d-4fa8b4c893a3 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1510 microversion: 2.1 time: 0.389069 Aug 24 09:04:15.901947 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 482/949] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:15 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:16.528326 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d5ca0407-cc72-4104-83e3-2ab0e72edffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:16.529151 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d5ca0407-cc72-4104-83e3-2ab0e72edffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:16.536214 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d5ca0407-cc72-4104-83e3-2ab0e72edffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:16.536822 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d5ca0407-cc72-4104-83e3-2ab0e72edffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:16.537349 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d5ca0407-cc72-4104-83e3-2ab0e72edffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:16.538156 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d5ca0407-cc72-4104-83e3-2ab0e72edffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:16.538663 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d5ca0407-cc72-4104-83e3-2ab0e72edffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:16.539135 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d5ca0407-cc72-4104-83e3-2ab0e72edffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:16.589340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-cdb5703b-c7b6-4556-ac15-31053e7c1fef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:16.589970 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-cdb5703b-c7b6-4556-ac15-31053e7c1fef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 91522d87-2654-4cee-9b8c-b7431ed55dd3] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:16.597501 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cdb5703b-c7b6-4556-ac15-31053e7c1fef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:16.598318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cdb5703b-c7b6-4556-ac15-31053e7c1fef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:16.598936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cdb5703b-c7b6-4556-ac15-31053e7c1fef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:16.599891 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cdb5703b-c7b6-4556-ac15-31053e7c1fef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:16.600582 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cdb5703b-c7b6-4556-ac15-31053e7c1fef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:16.601185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cdb5703b-c7b6-4556-ac15-31053e7c1fef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:16.618763 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-cdb5703b-c7b6-4556-ac15-31053e7c1fef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] HTTP exception thrown: Instance 91522d87-2654-4cee-9b8c-b7431ed55dd3 could not be found. Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-cdb5703b-c7b6-4556-ac15-31053e7c1fef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Request method failure captured: Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 HTTP/1.1 Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeVV9ImGTcRNmY4Hiln2vQcRMqL4RxwwQ_WIqLficzvTIx6Pz-RaHxnTth4Y2xKprHubC8bVxL5vpe6TejrqAfQJBa3lTvoqG4hzNbj0JnvBpSGphO-iVUfO5vGv_7r-6agc6A0AMKeemM4c2BBHlfPzWGZS8w3it_iG6hNJDNrWJE Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: c966c27f100846ca8cf06122ddc8c408 Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:04:16.621526 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:04:16.622951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c966c27f100846ca8cf06122ddc8c408", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:04:16.622951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 09:04:16.622951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: c966c27f100846ca8cf06122ddc8c408 Aug 24 09:04:16.622951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 09:04:16.622951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-ServerRescueNegativeTestJSON-509348674-project Aug 24 09:04:16.622951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:04:16.622951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:04:16.622951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: f56524e822e641bc9bb11eddfe27f85d Aug 24 09:04:16.622951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-ServerRescueNegativeTestJSON-509348674-project Aug 24 09:04:16.622951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:04:16.622951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 91522d87-2654-4cee-9b8c-b7431ed55dd3 could not be found. Aug 24 09:04:16.622951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '91522d87-2654-4cee-9b8c-b7431ed55dd3'} Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91522d87-2654-4cee-9b8c-b7431ed55dd3 could not be found. Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:04:16.623689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91522d87-2654-4cee-9b8c-b7431ed55dd3 could not be found. Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91522d87-2654-4cee-9b8c-b7431ed55dd3 could not be found. Aug 24 09:04:16.625272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:16.626587 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-cdb5703b-c7b6-4556-ac15-31053e7c1fef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Returning 404 to user: Instance 91522d87-2654-4cee-9b8c-b7431ed55dd3 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:04:16.626587 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-cdb5703b-c7b6-4556-ac15-31053e7c1fef tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3" status: 404 len: 111 microversion: 2.1 time: 0.038406 Aug 24 09:04:16.626587 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 483/950] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:16 2022] GET /compute/v2.1/servers/91522d87-2654-4cee-9b8c-b7431ed55dd3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 09:04:16.634900 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4c591fe3-b463-4e7a-a50e-1abb5436c557 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:16.635157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4c591fe3-b463-4e7a-a50e-1abb5436c557 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:16.642337 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4c591fe3-b463-4e7a-a50e-1abb5436c557 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:16.642929 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4c591fe3-b463-4e7a-a50e-1abb5436c557 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:16.643432 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4c591fe3-b463-4e7a-a50e-1abb5436c557 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:16.644900 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4c591fe3-b463-4e7a-a50e-1abb5436c557 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:16.644900 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4c591fe3-b463-4e7a-a50e-1abb5436c557 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:16.645342 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4c591fe3-b463-4e7a-a50e-1abb5436c557 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:16.679469 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4c591fe3-b463-4e7a-a50e-1abb5436c557 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Going to try to terminate instance {{(pid=132984) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:04:16.835436 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d5ca0407-cc72-4104-83e3-2ab0e72edffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:16.844743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d5ca0407-cc72-4104-83e3-2ab0e72edffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:16.846234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d5ca0407-cc72-4104-83e3-2ab0e72edffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:16.850725 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d5ca0407-cc72-4104-83e3-2ab0e72edffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1408 microversion: 2.20 time: 0.324805 Aug 24 09:04:16.850725 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 468/951] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:16 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1408 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:16.923999 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:16.924794 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:16.931847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:16.932301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:16.932966 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:16.933878 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:16.934509 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:16.935066 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:16.969277 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:16.969765 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:16.970193 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:16.970642 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lazy-loading 'fault' on Instance uuid 20347088-35b8-4cfe-8457-8ca131fcfa2c {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:04:17.012924 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:17.021164 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f00d476d-ebc8-4ce5-ab6e-3c4956b0249b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1230 microversion: 2.1 time: 0.101608 Aug 24 09:04:17.021728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 469/952] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:16 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:17.028736 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4c591fe3-b463-4e7a-a50e-1abb5436c557 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "DELETE /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 204 len: 0 microversion: 2.1 time: 0.399303 Aug 24 09:04:17.029429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 484/953] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:04:16 2022] DELETE /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:04:17.042999 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-aac4ad70-8ba7-4eb1-9217-ec60722de197 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:17.044115 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-aac4ad70-8ba7-4eb1-9217-ec60722de197 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:17.054780 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aac4ad70-8ba7-4eb1-9217-ec60722de197 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:17.055641 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aac4ad70-8ba7-4eb1-9217-ec60722de197 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:17.056378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aac4ad70-8ba7-4eb1-9217-ec60722de197 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:17.057623 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aac4ad70-8ba7-4eb1-9217-ec60722de197 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:17.058392 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aac4ad70-8ba7-4eb1-9217-ec60722de197 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:17.059202 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aac4ad70-8ba7-4eb1-9217-ec60722de197 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:17.231675 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-aac4ad70-8ba7-4eb1-9217-ec60722de197 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:17.243235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-aac4ad70-8ba7-4eb1-9217-ec60722de197 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.206447 Aug 24 09:04:17.244312 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 470/954] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:17 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:17.871276 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4169d2f9-4bfb-4f52-926a-4e8a5bcb1f1e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:17.871945 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4169d2f9-4bfb-4f52-926a-4e8a5bcb1f1e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:17.878508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4169d2f9-4bfb-4f52-926a-4e8a5bcb1f1e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:17.878982 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4169d2f9-4bfb-4f52-926a-4e8a5bcb1f1e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:17.879409 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4169d2f9-4bfb-4f52-926a-4e8a5bcb1f1e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:17.880095 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4169d2f9-4bfb-4f52-926a-4e8a5bcb1f1e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:17.880554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4169d2f9-4bfb-4f52-926a-4e8a5bcb1f1e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:17.880983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4169d2f9-4bfb-4f52-926a-4e8a5bcb1f1e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:18.025925 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4169d2f9-4bfb-4f52-926a-4e8a5bcb1f1e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:18.035785 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4169d2f9-4bfb-4f52-926a-4e8a5bcb1f1e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:18.037394 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4169d2f9-4bfb-4f52-926a-4e8a5bcb1f1e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:18.038531 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4169d2f9-4bfb-4f52-926a-4e8a5bcb1f1e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1408 microversion: 2.20 time: 0.172189 Aug 24 09:04:18.043447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 485/955] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:17 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:18.047493 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:18.048104 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:18.054711 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:18.055211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:18.055647 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:18.056337 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:18.056807 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:18.057267 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:18.088199 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:18.088716 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:18.089154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:18.089594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lazy-loading 'fault' on Instance uuid 20347088-35b8-4cfe-8457-8ca131fcfa2c {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:04:18.130134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:18.138251 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4dda88a7-959f-4d43-b975-b8581d7fa05f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 200 len: 1230 microversion: 2.1 time: 0.094790 Aug 24 09:04:18.138851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 471/956] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:18 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:18.265819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1c8604d3-fd45-4643-9e3f-dd414028417b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:18.266439 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1c8604d3-fd45-4643-9e3f-dd414028417b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:18.272602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1c8604d3-fd45-4643-9e3f-dd414028417b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:18.273098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1c8604d3-fd45-4643-9e3f-dd414028417b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:18.274050 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1c8604d3-fd45-4643-9e3f-dd414028417b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:18.274771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1c8604d3-fd45-4643-9e3f-dd414028417b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:18.275225 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1c8604d3-fd45-4643-9e3f-dd414028417b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:18.275657 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1c8604d3-fd45-4643-9e3f-dd414028417b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:18.415567 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1c8604d3-fd45-4643-9e3f-dd414028417b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:18.423589 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1c8604d3-fd45-4643-9e3f-dd414028417b tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.161932 Aug 24 09:04:18.424157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 486/957] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:18 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:18.990226 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0f26b651-05c9-4e38-9564-a90ba79eef37 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:18.992991 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0f26b651-05c9-4e38-9564-a90ba79eef37 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:18.998973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f26b651-05c9-4e38-9564-a90ba79eef37 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:18.999446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f26b651-05c9-4e38-9564-a90ba79eef37 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:18.999873 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f26b651-05c9-4e38-9564-a90ba79eef37 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.000679 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f26b651-05c9-4e38-9564-a90ba79eef37 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.001139 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f26b651-05c9-4e38-9564-a90ba79eef37 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.001565 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f26b651-05c9-4e38-9564-a90ba79eef37 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.035554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0f26b651-05c9-4e38-9564-a90ba79eef37 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049138 Aug 24 09:04:19.036019 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 472/958] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:04:18 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:04:19.065540 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9e2f2b52-3570-4d27-a8e2-0d92ae85a2a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:19.066153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9e2f2b52-3570-4d27-a8e2-0d92ae85a2a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:19.073176 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e2f2b52-3570-4d27-a8e2-0d92ae85a2a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.073700 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e2f2b52-3570-4d27-a8e2-0d92ae85a2a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.074176 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e2f2b52-3570-4d27-a8e2-0d92ae85a2a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.074852 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e2f2b52-3570-4d27-a8e2-0d92ae85a2a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.075309 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e2f2b52-3570-4d27-a8e2-0d92ae85a2a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.075733 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e2f2b52-3570-4d27-a8e2-0d92ae85a2a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.104186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-879e2297-6b59-42da-aa44-13722cbd41ff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:19.105626 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-879e2297-6b59-42da-aa44-13722cbd41ff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:19.115366 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-879e2297-6b59-42da-aa44-13722cbd41ff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.116153 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-879e2297-6b59-42da-aa44-13722cbd41ff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.116767 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-879e2297-6b59-42da-aa44-13722cbd41ff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.118193 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-879e2297-6b59-42da-aa44-13722cbd41ff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.118742 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-879e2297-6b59-42da-aa44-13722cbd41ff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.119969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-879e2297-6b59-42da-aa44-13722cbd41ff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.155784 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-879e2297-6b59-42da-aa44-13722cbd41ff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Going to try to terminate instance {{(pid=132985) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:04:19.292931 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9e2f2b52-3570-4d27-a8e2-0d92ae85a2a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:19.302331 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9e2f2b52-3570-4d27-a8e2-0d92ae85a2a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:19.304212 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9e2f2b52-3570-4d27-a8e2-0d92ae85a2a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:19.306245 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9e2f2b52-3570-4d27-a8e2-0d92ae85a2a7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1599 microversion: 2.20 time: 0.244872 Aug 24 09:04:19.307141 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 487/959] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:19 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1599 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:19.324587 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8c1f372a-6874-425f-a2d1-9ec33b6ac188 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:19.325823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8c1f372a-6874-425f-a2d1-9ec33b6ac188 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:19.335380 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8c1f372a-6874-425f-a2d1-9ec33b6ac188 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.337987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8c1f372a-6874-425f-a2d1-9ec33b6ac188 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.337987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8c1f372a-6874-425f-a2d1-9ec33b6ac188 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.337987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8c1f372a-6874-425f-a2d1-9ec33b6ac188 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.337987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8c1f372a-6874-425f-a2d1-9ec33b6ac188 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.338789 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8c1f372a-6874-425f-a2d1-9ec33b6ac188 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.358223 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-8c1f372a-6874-425f-a2d1-9ec33b6ac188 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] HTTP exception thrown: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8c1f372a-6874-425f-a2d1-9ec33b6ac188 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Request method failure captured: Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c HTTP/1.1 Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeha-c6uiuuPA8C79UuMcsTyaozqrSUaLK66JryF0q8DuN1JdixUvG99ZjPsPrGKl_XPJu2oT3faRBPoBHuFCRYw3w1Xa0bYcDM-c8_Xy49TW6uQIRSCl8eF4lbHkKlGRr6dwzaidJVDZo2aA8EIES-QOq71MpdD0AvXjsMXZ4f31MA Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 1f01e21018a54220ba1e54c6b7bfc400 Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:04:19.359916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:04:19.361645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1f01e21018a54220ba1e54c6b7bfc400", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:04:19.361645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:04:19.361645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 1f01e21018a54220ba1e54c6b7bfc400 Aug 24 09:04:19.361645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:04:19.361645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-TestVolumeBootPattern-1568297340-project Aug 24 09:04:19.361645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:04:19.361645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:04:19.361645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: c2c3752027f342a489e6eb9d3b540819 Aug 24 09:04:19.361645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-TestVolumeBootPattern-1568297340-project Aug 24 09:04:19.361645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:04:19.361645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:04:19.361645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '20347088-35b8-4cfe-8457-8ca131fcfa2c'} Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:04:19.362554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:04:19.363936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:19.365143 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8c1f372a-6874-425f-a2d1-9ec33b6ac188 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Returning 404 to user: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:04:19.365143 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8c1f372a-6874-425f-a2d1-9ec33b6ac188 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 404 len: 111 microversion: 2.1 time: 0.046602 Aug 24 09:04:19.365143 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 488/960] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:19 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:04:19.368122 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a3072142-e683-46eb-9c68-481c10aeb41a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:19.368262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a3072142-e683-46eb-9c68-481c10aeb41a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:19.380513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a3072142-e683-46eb-9c68-481c10aeb41a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.380513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a3072142-e683-46eb-9c68-481c10aeb41a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.380513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a3072142-e683-46eb-9c68-481c10aeb41a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.380513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a3072142-e683-46eb-9c68-481c10aeb41a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.380904 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a3072142-e683-46eb-9c68-481c10aeb41a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.380904 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a3072142-e683-46eb-9c68-481c10aeb41a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.531598 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-879e2297-6b59-42da-aa44-13722cbd41ff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 204 len: 0 microversion: 2.1 time: 0.432583 Aug 24 09:04:19.532581 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 473/961] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:04:19 2022] DELETE /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:04:19.538566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1475231101", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-320820006", "security_groups": [{"name": "tempest-secgroup-smoke-324555672"}], "block_device_mapping_v2": [{"uuid": "2786696b-0612-4a01-9541-85835db571f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a248e98a-364e-44f4-bc7f-3b491742a7df"}]}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:19.652126 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a3072142-e683-46eb-9c68-481c10aeb41a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.288698 Aug 24 09:04:19.652830 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 489/962] 10.222.0.55 () {60 vars in 1316 bytes} [Wed Aug 24 09:04:19 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/os-interface => generated 284 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:04:19.666132 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-95beaa13-fa90-481f-8d02-94e8b6c649bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:19.666850 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-95beaa13-fa90-481f-8d02-94e8b6c649bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:19.673516 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-95beaa13-fa90-481f-8d02-94e8b6c649bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.674243 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-95beaa13-fa90-481f-8d02-94e8b6c649bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.674780 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-95beaa13-fa90-481f-8d02-94e8b6c649bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.675604 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-95beaa13-fa90-481f-8d02-94e8b6c649bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.676168 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-95beaa13-fa90-481f-8d02-94e8b6c649bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.676740 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-95beaa13-fa90-481f-8d02-94e8b6c649bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.685697 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.network.neutron [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] validate_networks() for [('a248e98a-364e-44f4-bc7f-3b491742a7df', None, None, None, None, None)] {{(pid=132985) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:04:20.092410 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-95beaa13-fa90-481f-8d02-94e8b6c649bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:20.102851 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-95beaa13-fa90-481f-8d02-94e8b6c649bd tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1522 microversion: 2.1 time: 0.441109 Aug 24 09:04:20.117109 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 490/963] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:19 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:20.122482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5bac344a-1a00-4f3c-8480-e379ca8de4fa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:20.123425 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5bac344a-1a00-4f3c-8480-e379ca8de4fa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:20.125782 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:20.132340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5bac344a-1a00-4f3c-8480-e379ca8de4fa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:20.133774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5bac344a-1a00-4f3c-8480-e379ca8de4fa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:20.134423 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5bac344a-1a00-4f3c-8480-e379ca8de4fa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:20.135373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5bac344a-1a00-4f3c-8480-e379ca8de4fa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:20.136044 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5bac344a-1a00-4f3c-8480-e379ca8de4fa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:20.137597 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5bac344a-1a00-4f3c-8480-e379ca8de4fa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:20.178697 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Flavor limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:04:20.179183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Image limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:04:20.180034 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Flavor pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:04:20.180681 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Image pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:04:20.181130 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:04:20.191238 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:20.192431 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:20.192431 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:20.193327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:20.194294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:20.196981 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:20.222105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Getting quotas for project 1f01e21018a54220ba1e54c6b7bfc400. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:04:20.231992 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Getting quotas for user c2c3752027f342a489e6eb9d3b540819 and project 1f01e21018a54220ba1e54c6b7bfc400. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:04:20.307402 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Going to run 1 instances... {{(pid=132985) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:04:20.307402 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2786696b-0612-4a01-9541-85835db571f2',volume_size=None,volume_type=None)] {{(pid=132985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:04:20.512565 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5bac344a-1a00-4f3c-8480-e379ca8de4fa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:20.522016 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5bac344a-1a00-4f3c-8480-e379ca8de4fa tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1670 microversion: 2.1 time: 0.403335 Aug 24 09:04:20.522644 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 491/964] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:20 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1670 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:20.575226 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-5823ffb1-fe45-443b-8616-8780b40258e5 req-c1c0103a-9cd9-4da0-a428-564c662934ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e80c6c-b61f-42b6-9c29-cf86c7099e57", "name": "network-vif-deleted", "tag": "08f182dc-1537-4524-ac71-00ff617d64ef"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:20.588473 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-5823ffb1-fe45-443b-8616-8780b40258e5 req-c1c0103a-9cd9-4da0-a428-564c662934ed service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:20.588983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-5823ffb1-fe45-443b-8616-8780b40258e5 req-c1c0103a-9cd9-4da0-a428-564c662934ed service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:20.589600 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-5823ffb1-fe45-443b-8616-8780b40258e5 req-c1c0103a-9cd9-4da0-a428-564c662934ed service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:20.602681 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-5823ffb1-fe45-443b-8616-8780b40258e5 req-c1c0103a-9cd9-4da0-a428-564c662934ed service nova] Creating event network-vif-deleted:08f182dc-1537-4524-ac71-00ff617d64ef for instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 on hv-cinder-85221 Aug 24 09:04:20.607910 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-5823ffb1-fe45-443b-8616-8780b40258e5 req-c1c0103a-9cd9-4da0-a428-564c662934ed service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039938 Aug 24 09:04:20.611637 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 492/965] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:04:20.961620 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-51d20e49-fe1b-4f4f-b397-da132fcc8736 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.426586 Aug 24 09:04:20.963307 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 474/966] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 09:04:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:04:20.981209 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c1f5fed0-0981-4af4-80cc-2a03b9b8ba3d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:20.982064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c1f5fed0-0981-4af4-80cc-2a03b9b8ba3d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:21.110779 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c1f5fed0-0981-4af4-80cc-2a03b9b8ba3d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:21.124740 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c1f5fed0-0981-4af4-80cc-2a03b9b8ba3d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1094 microversion: 2.1 time: 0.150772 Aug 24 09:04:21.125285 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 493/967] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:20 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1094 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:21.127495 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:21.128515 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:21.152281 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:21.154355 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:21.156074 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:21.158502 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:21.159802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:21.160655 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:21.218799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:21.220149 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:21.220590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:21.221079 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lazy-loading 'fault' on Instance uuid 93e80c6c-b61f-42b6-9c29-cf86c7099e57 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:04:21.267688 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56524e822e641bc9bb11eddfe27f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c966c27f100846ca8cf06122ddc8c408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:21.288979 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ec57e2b3-a092-46e5-96e7-df829d05fec4 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 200 len: 1312 microversion: 2.1 time: 0.167854 Aug 24 09:04:21.290802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 475/968] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:21 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:21.558770 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b8b51e93-e91a-41c4-a35a-450cfd6b49ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:21.559584 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b8b51e93-e91a-41c4-a35a-450cfd6b49ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:21.568006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b8b51e93-e91a-41c4-a35a-450cfd6b49ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:21.568894 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b8b51e93-e91a-41c4-a35a-450cfd6b49ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:21.569525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b8b51e93-e91a-41c4-a35a-450cfd6b49ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:21.571351 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b8b51e93-e91a-41c4-a35a-450cfd6b49ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:21.572179 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b8b51e93-e91a-41c4-a35a-450cfd6b49ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:21.572851 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b8b51e93-e91a-41c4-a35a-450cfd6b49ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:21.868473 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b8b51e93-e91a-41c4-a35a-450cfd6b49ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:21.877602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b8b51e93-e91a-41c4-a35a-450cfd6b49ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1670 microversion: 2.1 time: 0.323804 Aug 24 09:04:21.878723 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 494/969] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:21 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1670 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:22.148857 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cb430fa9-6f31-4c35-8de1-14cb2627480a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:22.149480 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-cb430fa9-6f31-4c35-8de1-14cb2627480a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:22.156464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cb430fa9-6f31-4c35-8de1-14cb2627480a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:22.157940 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cb430fa9-6f31-4c35-8de1-14cb2627480a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:22.158384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cb430fa9-6f31-4c35-8de1-14cb2627480a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:22.159109 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cb430fa9-6f31-4c35-8de1-14cb2627480a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:22.159566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cb430fa9-6f31-4c35-8de1-14cb2627480a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:22.159985 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-cb430fa9-6f31-4c35-8de1-14cb2627480a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:22.240806 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-cb430fa9-6f31-4c35-8de1-14cb2627480a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:22.251264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-cb430fa9-6f31-4c35-8de1-14cb2627480a tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1144 microversion: 2.1 time: 0.106331 Aug 24 09:04:22.251981 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 476/970] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:22 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1144 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:22.312187 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3fd34df3-b47b-4d97-8290-7a3cf72fe4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:22.313678 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3fd34df3-b47b-4d97-8290-7a3cf72fe4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] [instance: 93e80c6c-b61f-42b6-9c29-cf86c7099e57] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:22.322495 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3fd34df3-b47b-4d97-8290-7a3cf72fe4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:22.323086 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3fd34df3-b47b-4d97-8290-7a3cf72fe4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:22.323590 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3fd34df3-b47b-4d97-8290-7a3cf72fe4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:22.325201 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3fd34df3-b47b-4d97-8290-7a3cf72fe4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:22.325743 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3fd34df3-b47b-4d97-8290-7a3cf72fe4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:22.326380 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3fd34df3-b47b-4d97-8290-7a3cf72fe4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:22.342470 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-3fd34df3-b47b-4d97-8290-7a3cf72fe4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] HTTP exception thrown: Instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 could not be found. Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3fd34df3-b47b-4d97-8290-7a3cf72fe4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Request method failure captured: Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 HTTP/1.1 Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeVV9ImGTcRNmY4Hiln2vQcRMqL4RxwwQ_WIqLficzvTIx6Pz-RaHxnTth4Y2xKprHubC8bVxL5vpe6TejrqAfQJBa3lTvoqG4hzNbj0JnvBpSGphO-iVUfO5vGv_7r-6agc6A0AMKeemM4c2BBHlfPzWGZS8w3it_iG6hNJDNrWJE Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: c966c27f100846ca8cf06122ddc8c408 Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:04:22.344025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:04:22.345610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c966c27f100846ca8cf06122ddc8c408", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c966c27f100846ca8cf06122ddc8c408"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:04:22.345610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 09:04:22.345610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: c966c27f100846ca8cf06122ddc8c408 Aug 24 09:04:22.345610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-509348674 Aug 24 09:04:22.345610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-ServerRescueNegativeTestJSON-509348674-project Aug 24 09:04:22.345610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:04:22.345610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:04:22.345610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: f56524e822e641bc9bb11eddfe27f85d Aug 24 09:04:22.345610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-ServerRescueNegativeTestJSON-509348674-project Aug 24 09:04:22.345610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:04:22.345610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 could not be found. Aug 24 09:04:22.345610 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '93e80c6c-b61f-42b6-9c29-cf86c7099e57'} Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 could not be found. Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:04:22.346404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 could not be found. Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 could not be found. Aug 24 09:04:22.347836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:04:22.357702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3fd34df3-b47b-4d97-8290-7a3cf72fe4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] Returning 404 to user: Instance 93e80c6c-b61f-42b6-9c29-cf86c7099e57 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:04:22.357702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3fd34df3-b47b-4d97-8290-7a3cf72fe4a3 tempest-ServerRescueNegativeTestJSON-509348674 tempest-ServerRescueNegativeTestJSON-509348674-project] 10.222.0.55 "GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57" status: 404 len: 111 microversion: 2.1 time: 0.038662 Aug 24 09:04:22.357702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 495/971] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:22 2022] GET /compute/v2.1/servers/93e80c6c-b61f-42b6-9c29-cf86c7099e57 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:04:22.632458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-cc7c496f-4d83-4414-93ef-0060a74d25e0 req-a04ec4b8-a995-4d8a-be80-0d7caba8c42c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97fe50f9-e517-4e9a-80b5-6faba0b9f10a", "tag": "8d40ee89-fb81-4d38-99c2-3dac67fab1b0"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:22.688247 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-cc7c496f-4d83-4414-93ef-0060a74d25e0 req-a04ec4b8-a995-4d8a-be80-0d7caba8c42c service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:22.702070 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-cc7c496f-4d83-4414-93ef-0060a74d25e0 req-a04ec4b8-a995-4d8a-be80-0d7caba8c42c service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:22.703323 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-cc7c496f-4d83-4414-93ef-0060a74d25e0 req-a04ec4b8-a995-4d8a-be80-0d7caba8c42c service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:22.731151 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:22.749136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-cc7c496f-4d83-4414-93ef-0060a74d25e0 req-a04ec4b8-a995-4d8a-be80-0d7caba8c42c service nova] Creating event network-changed:8d40ee89-fb81-4d38-99c2-3dac67fab1b0 for instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a on hv-cinder-85221 Aug 24 09:04:22.766925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-cc7c496f-4d83-4414-93ef-0060a74d25e0 req-a04ec4b8-a995-4d8a-be80-0d7caba8c42c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140455 Aug 24 09:04:22.769110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 477/972] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:22.901970 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b2d57780-c20b-440e-9c77-19583934f6ed tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:22.902978 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b2d57780-c20b-440e-9c77-19583934f6ed tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:22.916282 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b2d57780-c20b-440e-9c77-19583934f6ed tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:22.917230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b2d57780-c20b-440e-9c77-19583934f6ed tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:22.918107 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b2d57780-c20b-440e-9c77-19583934f6ed tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:22.919108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b2d57780-c20b-440e-9c77-19583934f6ed tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:22.919820 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b2d57780-c20b-440e-9c77-19583934f6ed tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:22.920475 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b2d57780-c20b-440e-9c77-19583934f6ed tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:23.036353 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b2d57780-c20b-440e-9c77-19583934f6ed tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:23.052410 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b2d57780-c20b-440e-9c77-19583934f6ed tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1603 microversion: 2.1 time: 0.153385 Aug 24 09:04:23.062405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 496/973] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:22 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1603 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:23.275413 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ae977f98-2a44-4dc1-acba-0f13d987e375 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:23.276281 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ae977f98-2a44-4dc1-acba-0f13d987e375 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:23.292173 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae977f98-2a44-4dc1-acba-0f13d987e375 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:23.292688 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae977f98-2a44-4dc1-acba-0f13d987e375 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:23.293371 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae977f98-2a44-4dc1-acba-0f13d987e375 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:23.294991 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae977f98-2a44-4dc1-acba-0f13d987e375 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:23.295665 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae977f98-2a44-4dc1-acba-0f13d987e375 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:23.296479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae977f98-2a44-4dc1-acba-0f13d987e375 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:23.629516 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ae977f98-2a44-4dc1-acba-0f13d987e375 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:23.641970 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ae977f98-2a44-4dc1-acba-0f13d987e375 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1192 microversion: 2.1 time: 0.371282 Aug 24 09:04:23.657644 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 478/974] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:23 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1192 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:24.088091 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:24.088969 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:24.096036 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:24.096778 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:24.097003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:24.097790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:24.098180 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:24.099018 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:24.148497 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:24.149379 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:24.150060 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:24.150682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lazy-loading 'fault' on Instance uuid 9a46236b-ed03-4f8e-8eba-3d04a06056a1 {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:04:24.342828 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:24.379651 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2c2e10bb-3b55-4d4a-86e4-4100fad50107 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 200 len: 1326 microversion: 2.1 time: 0.295772 Aug 24 09:04:24.394916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 497/975] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:24 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 1326 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:24.664780 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-113fff5b-d8a4-4a19-8635-362a087fcd9f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:24.674545 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-113fff5b-d8a4-4a19-8635-362a087fcd9f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:24.674545 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-113fff5b-d8a4-4a19-8635-362a087fcd9f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:24.674545 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-113fff5b-d8a4-4a19-8635-362a087fcd9f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:24.674545 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-113fff5b-d8a4-4a19-8635-362a087fcd9f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:24.680320 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-113fff5b-d8a4-4a19-8635-362a087fcd9f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:24.680320 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-113fff5b-d8a4-4a19-8635-362a087fcd9f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:24.680320 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-113fff5b-d8a4-4a19-8635-362a087fcd9f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:24.765658 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-113fff5b-d8a4-4a19-8635-362a087fcd9f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:24.776631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-113fff5b-d8a4-4a19-8635-362a087fcd9f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1210 microversion: 2.1 time: 0.116247 Aug 24 09:04:24.777603 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 479/976] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:24 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:24.782665 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-3643c44c-7121-43d9-ac21-2774e2adc69e req-6e9a64fa-b965-45c2-a658-ec5666779334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a46236b-ed03-4f8e-8eba-3d04a06056a1", "name": "network-vif-deleted", "tag": "53dc34cd-6619-41da-8d76-3a1724dbcce6"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:24.794037 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-3643c44c-7121-43d9-ac21-2774e2adc69e req-6e9a64fa-b965-45c2-a658-ec5666779334 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:24.794862 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-3643c44c-7121-43d9-ac21-2774e2adc69e req-6e9a64fa-b965-45c2-a658-ec5666779334 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:24.795497 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-3643c44c-7121-43d9-ac21-2774e2adc69e req-6e9a64fa-b965-45c2-a658-ec5666779334 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:24.800143 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:24.810937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-3643c44c-7121-43d9-ac21-2774e2adc69e req-6e9a64fa-b965-45c2-a658-ec5666779334 service nova] Creating event network-vif-deleted:53dc34cd-6619-41da-8d76-3a1724dbcce6 for instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 on hv-cinder-85221 Aug 24 09:04:24.816712 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-3643c44c-7121-43d9-ac21-2774e2adc69e req-6e9a64fa-b965-45c2-a658-ec5666779334 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037770 Aug 24 09:04:24.817631 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 498/977] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:25.417064 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0e0a5081-4025-41a3-8fbe-c17372616661 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:25.418311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0e0a5081-4025-41a3-8fbe-c17372616661 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:25.427184 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0e0a5081-4025-41a3-8fbe-c17372616661 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:25.428487 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0e0a5081-4025-41a3-8fbe-c17372616661 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:25.429191 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0e0a5081-4025-41a3-8fbe-c17372616661 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:25.431264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0e0a5081-4025-41a3-8fbe-c17372616661 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:25.432567 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0e0a5081-4025-41a3-8fbe-c17372616661 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:25.433244 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0e0a5081-4025-41a3-8fbe-c17372616661 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:25.455327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-0e0a5081-4025-41a3-8fbe-c17372616661 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] HTTP exception thrown: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0e0a5081-4025-41a3-8fbe-c17372616661 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Request method failure captured: Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 HTTP/1.1 Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeQxdz4yyMwfuy4AeW2YWC8zGlOF5k8702uYch7aWwkOyrDPGq2h_tsrnxOyQwCp9Iye0ujLb8Yo-DOBeXuMxvcUK2LjZGwldFOEqm03AixiGm3Ntb--_OjdaEtHcLgGkj4wvymjjYbUueFsAkuoagUeQrOT8EQQPHolTa3NeMyGpg Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 02d5c74d88a24eb9814f49a6ff4eca56 Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:04:25.457210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:04:25.462657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_02d5c74d88a24eb9814f49a6ff4eca56", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:04:25.462657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:04:25.462657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 02d5c74d88a24eb9814f49a6ff4eca56 Aug 24 09:04:25.462657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:04:25.462657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-AttachVolumeTestJSON-1534009168-project Aug 24 09:04:25.462657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:04:25.462657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:04:25.462657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: f5d7aee76519492e81b0048edebba36f Aug 24 09:04:25.462657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-AttachVolumeTestJSON-1534009168-project Aug 24 09:04:25.462657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:04:25.462657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:04:25.462657 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': '9a46236b-ed03-4f8e-8eba-3d04a06056a1'} Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:04:25.463984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:04:25.466380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:04:25.467728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0e0a5081-4025-41a3-8fbe-c17372616661 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Returning 404 to user: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:04:25.467728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0e0a5081-4025-41a3-8fbe-c17372616661 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 404 len: 111 microversion: 2.1 time: 0.048003 Aug 24 09:04:25.467728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 480/978] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:25 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:04:25.471255 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8fd6c9d5-e3f6-48f4-b3be-3afc5746e9f2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '.version_select at 0x7f16ae472c10>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:25.591301 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8fd6c9d5-e3f6-48f4-b3be-3afc5746e9f2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-518661313" status: 202 len: 0 microversion: 2.1 time: 0.125646 Aug 24 09:04:25.592233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 499/979] 10.222.0.55 () {58 vars in 1218 bytes} [Wed Aug 24 09:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-518661313 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:04:25.802367 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-065cc7d3-ff95-47d2-b599-f5796d096fff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:25.803564 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-065cc7d3-ff95-47d2-b599-f5796d096fff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:25.826473 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-065cc7d3-ff95-47d2-b599-f5796d096fff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:25.829193 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-065cc7d3-ff95-47d2-b599-f5796d096fff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:25.831287 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-065cc7d3-ff95-47d2-b599-f5796d096fff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:25.832228 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-065cc7d3-ff95-47d2-b599-f5796d096fff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:25.834351 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-065cc7d3-ff95-47d2-b599-f5796d096fff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:25.837353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-065cc7d3-ff95-47d2-b599-f5796d096fff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:26.224515 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-065cc7d3-ff95-47d2-b599-f5796d096fff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:26.245028 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-065cc7d3-ff95-47d2-b599-f5796d096fff tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1277 microversion: 2.1 time: 0.449751 Aug 24 09:04:26.246535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 481/980] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:25 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1277 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:26.894786 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-e0648912-4c38-4c2b-a23c-7561445bee8c req-a4d2fde4-947c-4ab9-b55a-f73d8b41a6bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b018901-74c5-4165-9944-187550602e1b", "tag": "9b0a2310-da6c-4502-994f-28bf901ef586"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:26.907614 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-e0648912-4c38-4c2b-a23c-7561445bee8c req-a4d2fde4-947c-4ab9-b55a-f73d8b41a6bc service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:26.908343 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-e0648912-4c38-4c2b-a23c-7561445bee8c req-a4d2fde4-947c-4ab9-b55a-f73d8b41a6bc service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:26.908982 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-e0648912-4c38-4c2b-a23c-7561445bee8c req-a4d2fde4-947c-4ab9-b55a-f73d8b41a6bc service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:26.923504 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-e0648912-4c38-4c2b-a23c-7561445bee8c req-a4d2fde4-947c-4ab9-b55a-f73d8b41a6bc service nova] Creating event network-changed:9b0a2310-da6c-4502-994f-28bf901ef586 for instance 3b018901-74c5-4165-9944-187550602e1b on hv-cinder-85221 Aug 24 09:04:26.937153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-e0648912-4c38-4c2b-a23c-7561445bee8c req-a4d2fde4-947c-4ab9-b55a-f73d8b41a6bc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049985 Aug 24 09:04:26.938260 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 500/981] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:26.959881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-da170e74-7eea-4e91-9d8a-4caadf9b0733 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Action: 'create', calling method: .version_select at 0x7f16ae34df70>, body: {"keypair": {"name": "tempest-keypair-290502672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9ffNY22H7ArFL4l+PDfhT1MJQmtOrlErK1vH5pg7DzfxCOkS6bqMKUcJVX7/CW8fXlqC7xRetpTx0+KUSKutbeGsT3zrx/1st5WH75hyDU7khWCslCUF5SDHAR3vWkfQ=="}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:26.993089 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-da170e74-7eea-4e91-9d8a-4caadf9b0733 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Getting quotas for project 02d5c74d88a24eb9814f49a6ff4eca56. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:04:26.997848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-da170e74-7eea-4e91-9d8a-4caadf9b0733 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Getting quotas for user f5d7aee76519492e81b0048edebba36f and project 02d5c74d88a24eb9814f49a6ff4eca56. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:04:27.106972 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-da170e74-7eea-4e91-9d8a-4caadf9b0733 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.150945 Aug 24 09:04:27.107701 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 482/982] 10.222.0.55 () {60 vars in 1159 bytes} [Wed Aug 24 09:04:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:27.268460 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-875b83be-4245-4e22-9b7b-f06791a51a7f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:27.269233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-875b83be-4245-4e22-9b7b-f06791a51a7f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:27.276429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-875b83be-4245-4e22-9b7b-f06791a51a7f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:27.276954 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-875b83be-4245-4e22-9b7b-f06791a51a7f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:27.277649 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-875b83be-4245-4e22-9b7b-f06791a51a7f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:27.278704 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-875b83be-4245-4e22-9b7b-f06791a51a7f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:27.279312 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-875b83be-4245-4e22-9b7b-f06791a51a7f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:27.280196 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-875b83be-4245-4e22-9b7b-f06791a51a7f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:27.577724 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-875b83be-4245-4e22-9b7b-f06791a51a7f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:27.589782 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-875b83be-4245-4e22-9b7b-f06791a51a7f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1265 microversion: 2.1 time: 0.325896 Aug 24 09:04:27.591418 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 501/983] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:27 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:28.615528 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3a0759b7-59c7-4099-9194-13ac51b32f01 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:28.616164 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3a0759b7-59c7-4099-9194-13ac51b32f01 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:28.623265 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3a0759b7-59c7-4099-9194-13ac51b32f01 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:28.623759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3a0759b7-59c7-4099-9194-13ac51b32f01 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:28.624190 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3a0759b7-59c7-4099-9194-13ac51b32f01 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:28.624913 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3a0759b7-59c7-4099-9194-13ac51b32f01 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:28.625360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3a0759b7-59c7-4099-9194-13ac51b32f01 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:28.625779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3a0759b7-59c7-4099-9194-13ac51b32f01 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:28.769532 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3a0759b7-59c7-4099-9194-13ac51b32f01 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:28.778625 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3a0759b7-59c7-4099-9194-13ac51b32f01 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1265 microversion: 2.1 time: 0.166930 Aug 24 09:04:28.779618 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 483/984] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:28 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:29.800232 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-368963b7-bd61-4795-8118-0382a01124d8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:29.801436 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-368963b7-bd61-4795-8118-0382a01124d8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:29.808670 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-368963b7-bd61-4795-8118-0382a01124d8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:29.809169 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-368963b7-bd61-4795-8118-0382a01124d8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:29.809833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-368963b7-bd61-4795-8118-0382a01124d8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:29.810753 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-368963b7-bd61-4795-8118-0382a01124d8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:29.811359 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-368963b7-bd61-4795-8118-0382a01124d8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:29.811968 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-368963b7-bd61-4795-8118-0382a01124d8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:29.950754 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-368963b7-bd61-4795-8118-0382a01124d8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:29.958500 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-368963b7-bd61-4795-8118-0382a01124d8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1265 microversion: 2.1 time: 0.162014 Aug 24 09:04:29.959076 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 502/985] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:29 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:30.546905 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1820452922", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1dfbf550-bd95-483b-86a8-88a800c12481"}], "security_groups": [{"name": "tempest-securitygroup--951355609"}], "key_name": "tempest-keypair-290502672", "user_data": "}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:30.555722 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:30.671582 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.network.neutron [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] validate_networks() for [('1dfbf550-bd95-483b-86a8-88a800c12481', None, None, None, None, None)] {{(pid=132985) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:04:30.980117 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-eec64b53-69e4-4333-8ae9-6f6822beb5ab tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:30.981400 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-eec64b53-69e4-4333-8ae9-6f6822beb5ab tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:30.988473 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eec64b53-69e4-4333-8ae9-6f6822beb5ab tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:30.989013 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eec64b53-69e4-4333-8ae9-6f6822beb5ab tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:30.989447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eec64b53-69e4-4333-8ae9-6f6822beb5ab tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:30.990154 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eec64b53-69e4-4333-8ae9-6f6822beb5ab tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:30.990619 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eec64b53-69e4-4333-8ae9-6f6822beb5ab tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:30.991040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eec64b53-69e4-4333-8ae9-6f6822beb5ab tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:31.114587 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Flavor limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:04:31.115143 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Image limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:04:31.115728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Flavor pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:04:31.116264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Image pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:04:31.116904 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:04:31.118394 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:31.130863 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:31.183471 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:31.183471 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:31.183471 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:31.183471 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:31.184193 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:31.184193 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Getting quotas for project 02d5c74d88a24eb9814f49a6ff4eca56. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:04:31.184193 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Getting quotas for user f5d7aee76519492e81b0048edebba36f and project 02d5c74d88a24eb9814f49a6ff4eca56. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:04:31.184438 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-eec64b53-69e4-4333-8ae9-6f6822beb5ab tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:31.184579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Going to run 1 instances... {{(pid=132985) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:04:31.184579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:04:31.184796 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-eec64b53-69e4-4333-8ae9-6f6822beb5ab tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1265 microversion: 2.1 time: 0.195737 Aug 24 09:04:31.184796 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 503/986] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:30 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:31.361822 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-022e9805-f712-4a78-afa4-90c5e51db931 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.819312 Aug 24 09:04:31.362508 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 484/987] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 09:04:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:04:31.374616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e95d650b-82e2-4f12-8305-2b2080c5dd16 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:31.375772 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e95d650b-82e2-4f12-8305-2b2080c5dd16 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:31.433724 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e95d650b-82e2-4f12-8305-2b2080c5dd16 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:31.461497 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e95d650b-82e2-4f12-8305-2b2080c5dd16 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1237 microversion: 2.1 time: 0.090106 Aug 24 09:04:31.462086 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 504/988] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:31 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:32.212385 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-480d464a-54d0-4bfc-ac8f-4e795b50097c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:32.213131 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-480d464a-54d0-4bfc-ac8f-4e795b50097c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:32.220768 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-480d464a-54d0-4bfc-ac8f-4e795b50097c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:32.221281 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-480d464a-54d0-4bfc-ac8f-4e795b50097c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:32.221718 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-480d464a-54d0-4bfc-ac8f-4e795b50097c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:32.222444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-480d464a-54d0-4bfc-ac8f-4e795b50097c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:32.222897 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-480d464a-54d0-4bfc-ac8f-4e795b50097c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:32.223331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-480d464a-54d0-4bfc-ac8f-4e795b50097c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:32.363777 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-480d464a-54d0-4bfc-ac8f-4e795b50097c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:32.372313 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-480d464a-54d0-4bfc-ac8f-4e795b50097c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1265 microversion: 2.1 time: 0.164818 Aug 24 09:04:32.372919 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 485/989] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:32 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:32.483066 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f72d34c2-507c-4d9e-b1ef-ff96d6a093c4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:32.483649 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f72d34c2-507c-4d9e-b1ef-ff96d6a093c4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:32.490219 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f72d34c2-507c-4d9e-b1ef-ff96d6a093c4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:32.490691 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f72d34c2-507c-4d9e-b1ef-ff96d6a093c4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:32.491121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f72d34c2-507c-4d9e-b1ef-ff96d6a093c4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:32.491808 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f72d34c2-507c-4d9e-b1ef-ff96d6a093c4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:32.492805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f72d34c2-507c-4d9e-b1ef-ff96d6a093c4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:32.493280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f72d34c2-507c-4d9e-b1ef-ff96d6a093c4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:32.555865 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f72d34c2-507c-4d9e-b1ef-ff96d6a093c4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:32.563718 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f72d34c2-507c-4d9e-b1ef-ff96d6a093c4 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1241 microversion: 2.1 time: 0.084633 Aug 24 09:04:32.564295 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 505/990] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:32 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:33.393911 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d631293a-9833-4f37-be04-d4e79367a4c0 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:33.394644 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d631293a-9833-4f37-be04-d4e79367a4c0 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:33.401970 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d631293a-9833-4f37-be04-d4e79367a4c0 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:33.402546 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d631293a-9833-4f37-be04-d4e79367a4c0 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:33.403052 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d631293a-9833-4f37-be04-d4e79367a4c0 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:33.403830 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d631293a-9833-4f37-be04-d4e79367a4c0 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:33.404351 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d631293a-9833-4f37-be04-d4e79367a4c0 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:33.404871 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d631293a-9833-4f37-be04-d4e79367a4c0 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:33.543874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d631293a-9833-4f37-be04-d4e79367a4c0 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:33.552152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d631293a-9833-4f37-be04-d4e79367a4c0 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1265 microversion: 2.1 time: 0.162125 Aug 24 09:04:33.552797 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 486/991] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:33 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:33.587085 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d1725a47-9d1d-46dd-8759-9d9885add9eb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:33.587739 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d1725a47-9d1d-46dd-8759-9d9885add9eb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:33.594561 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d1725a47-9d1d-46dd-8759-9d9885add9eb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:33.595036 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d1725a47-9d1d-46dd-8759-9d9885add9eb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:33.595463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d1725a47-9d1d-46dd-8759-9d9885add9eb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:33.596148 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d1725a47-9d1d-46dd-8759-9d9885add9eb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:33.596631 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d1725a47-9d1d-46dd-8759-9d9885add9eb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:33.597147 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d1725a47-9d1d-46dd-8759-9d9885add9eb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:33.663170 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d1725a47-9d1d-46dd-8759-9d9885add9eb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:33.671237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d1725a47-9d1d-46dd-8759-9d9885add9eb tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1289 microversion: 2.1 time: 0.088852 Aug 24 09:04:33.671838 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 506/992] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:33 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:34.574215 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4771db88-652c-4a06-9ee7-d997bde6a858 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:34.575101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4771db88-652c-4a06-9ee7-d997bde6a858 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:34.581600 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4771db88-652c-4a06-9ee7-d997bde6a858 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:34.582209 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4771db88-652c-4a06-9ee7-d997bde6a858 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:34.582802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4771db88-652c-4a06-9ee7-d997bde6a858 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:34.583705 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4771db88-652c-4a06-9ee7-d997bde6a858 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:34.584158 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4771db88-652c-4a06-9ee7-d997bde6a858 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:34.584661 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4771db88-652c-4a06-9ee7-d997bde6a858 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:34.699211 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3c44c1bd-7d16-47ce-9595-10f88863f2ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:34.699211 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3c44c1bd-7d16-47ce-9595-10f88863f2ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:34.700304 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c44c1bd-7d16-47ce-9595-10f88863f2ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:34.700983 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c44c1bd-7d16-47ce-9595-10f88863f2ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:34.701524 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c44c1bd-7d16-47ce-9595-10f88863f2ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:34.702344 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c44c1bd-7d16-47ce-9595-10f88863f2ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:34.702901 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c44c1bd-7d16-47ce-9595-10f88863f2ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:34.703488 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3c44c1bd-7d16-47ce-9595-10f88863f2ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:34.748098 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4771db88-652c-4a06-9ee7-d997bde6a858 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:34.756860 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4771db88-652c-4a06-9ee7-d997bde6a858 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1265 microversion: 2.1 time: 0.187471 Aug 24 09:04:34.757447 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 487/993] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:34 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:34.844766 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3c44c1bd-7d16-47ce-9595-10f88863f2ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:34.853017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3c44c1bd-7d16-47ce-9595-10f88863f2ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1362 microversion: 2.1 time: 0.164780 Aug 24 09:04:34.853511 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 507/994] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:34 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:35.777917 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ff6d9082-52e5-41e6-9308-3f3cdfee2d78 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:35.778603 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ff6d9082-52e5-41e6-9308-3f3cdfee2d78 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:35.781080 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:35.786944 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ff6d9082-52e5-41e6-9308-3f3cdfee2d78 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:35.787431 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ff6d9082-52e5-41e6-9308-3f3cdfee2d78 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:35.787874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ff6d9082-52e5-41e6-9308-3f3cdfee2d78 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:35.788624 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ff6d9082-52e5-41e6-9308-3f3cdfee2d78 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:35.789599 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ff6d9082-52e5-41e6-9308-3f3cdfee2d78 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:35.795621 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ff6d9082-52e5-41e6-9308-3f3cdfee2d78 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:35.881022 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f6773f9b-22a6-442e-add2-98e4ebf9834b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:35.882053 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f6773f9b-22a6-442e-add2-98e4ebf9834b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:35.893557 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f6773f9b-22a6-442e-add2-98e4ebf9834b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:35.894543 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f6773f9b-22a6-442e-add2-98e4ebf9834b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:35.895451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f6773f9b-22a6-442e-add2-98e4ebf9834b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:35.896770 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f6773f9b-22a6-442e-add2-98e4ebf9834b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:35.897606 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f6773f9b-22a6-442e-add2-98e4ebf9834b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:35.898374 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f6773f9b-22a6-442e-add2-98e4ebf9834b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:36.001854 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ff6d9082-52e5-41e6-9308-3f3cdfee2d78 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:36.010315 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ff6d9082-52e5-41e6-9308-3f3cdfee2d78 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1265 microversion: 2.1 time: 0.236422 Aug 24 09:04:36.011358 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 488/995] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:35 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:36.043464 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f6773f9b-22a6-442e-add2-98e4ebf9834b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:36.051363 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f6773f9b-22a6-442e-add2-98e4ebf9834b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1362 microversion: 2.1 time: 0.175507 Aug 24 09:04:36.051947 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 508/996] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:35 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:36.467671 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-bd479a03-9465-429d-8b73-67dd5b28c6d7 req-4a5d225c-c15f-4963-91cf-968cf3fdf1ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db3a6687-812a-4169-96f5-0e7e9f3af30f", "tag": "4e7b91b0-5780-4eab-adff-f304152da4c2"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:36.478412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-bd479a03-9465-429d-8b73-67dd5b28c6d7 req-4a5d225c-c15f-4963-91cf-968cf3fdf1ce service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:36.478880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-bd479a03-9465-429d-8b73-67dd5b28c6d7 req-4a5d225c-c15f-4963-91cf-968cf3fdf1ce service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:36.479522 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-bd479a03-9465-429d-8b73-67dd5b28c6d7 req-4a5d225c-c15f-4963-91cf-968cf3fdf1ce service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:36.491788 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-bd479a03-9465-429d-8b73-67dd5b28c6d7 req-4a5d225c-c15f-4963-91cf-968cf3fdf1ce service nova] Creating event network-changed:4e7b91b0-5780-4eab-adff-f304152da4c2 for instance db3a6687-812a-4169-96f5-0e7e9f3af30f on hv-cinder-85221 Aug 24 09:04:36.496993 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-bd479a03-9465-429d-8b73-67dd5b28c6d7 req-4a5d225c-c15f-4963-91cf-968cf3fdf1ce service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033191 Aug 24 09:04:36.497603 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 489/997] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:37.032371 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-691bff93-d7d3-498e-b1b5-6208790340dd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:37.033031 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-691bff93-d7d3-498e-b1b5-6208790340dd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:37.040429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-691bff93-d7d3-498e-b1b5-6208790340dd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:37.041033 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-691bff93-d7d3-498e-b1b5-6208790340dd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:37.041997 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-691bff93-d7d3-498e-b1b5-6208790340dd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:37.042780 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-691bff93-d7d3-498e-b1b5-6208790340dd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:37.043776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-691bff93-d7d3-498e-b1b5-6208790340dd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:37.044274 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-691bff93-d7d3-498e-b1b5-6208790340dd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:37.073618 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-28bd31a6-8a9e-43a2-88df-158fdf26ac9a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:37.075252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-28bd31a6-8a9e-43a2-88df-158fdf26ac9a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:37.083590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-28bd31a6-8a9e-43a2-88df-158fdf26ac9a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:37.084362 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-28bd31a6-8a9e-43a2-88df-158fdf26ac9a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:37.084992 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-28bd31a6-8a9e-43a2-88df-158fdf26ac9a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:37.086068 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-28bd31a6-8a9e-43a2-88df-158fdf26ac9a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:37.086705 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-28bd31a6-8a9e-43a2-88df-158fdf26ac9a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:37.087285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-28bd31a6-8a9e-43a2-88df-158fdf26ac9a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:37.201447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-691bff93-d7d3-498e-b1b5-6208790340dd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:37.212357 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-691bff93-d7d3-498e-b1b5-6208790340dd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1265 microversion: 2.1 time: 0.184185 Aug 24 09:04:37.213609 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 509/998] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:37 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:37.345359 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-28bd31a6-8a9e-43a2-88df-158fdf26ac9a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:37.353838 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-28bd31a6-8a9e-43a2-88df-158fdf26ac9a tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1362 microversion: 2.1 time: 0.285006 Aug 24 09:04:37.354419 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 490/999] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:37 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:38.237963 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-88e7a4a2-8839-4e50-a6aa-bae6f98b5e62 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:38.238730 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-88e7a4a2-8839-4e50-a6aa-bae6f98b5e62 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:38.248321 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88e7a4a2-8839-4e50-a6aa-bae6f98b5e62 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:38.249144 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88e7a4a2-8839-4e50-a6aa-bae6f98b5e62 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:38.249574 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88e7a4a2-8839-4e50-a6aa-bae6f98b5e62 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:38.250501 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88e7a4a2-8839-4e50-a6aa-bae6f98b5e62 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:38.250966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88e7a4a2-8839-4e50-a6aa-bae6f98b5e62 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:38.251399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-88e7a4a2-8839-4e50-a6aa-bae6f98b5e62 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:38.375330 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fcb48e39-d273-4e13-9a00-8a2bd1d4d9ce tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:38.376647 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-fcb48e39-d273-4e13-9a00-8a2bd1d4d9ce tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:38.383938 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fcb48e39-d273-4e13-9a00-8a2bd1d4d9ce tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:38.384514 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fcb48e39-d273-4e13-9a00-8a2bd1d4d9ce tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:38.385037 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fcb48e39-d273-4e13-9a00-8a2bd1d4d9ce tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:38.385992 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fcb48e39-d273-4e13-9a00-8a2bd1d4d9ce tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:38.386440 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fcb48e39-d273-4e13-9a00-8a2bd1d4d9ce tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:38.387031 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fcb48e39-d273-4e13-9a00-8a2bd1d4d9ce tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:38.408256 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-88e7a4a2-8839-4e50-a6aa-bae6f98b5e62 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:38.417691 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-88e7a4a2-8839-4e50-a6aa-bae6f98b5e62 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1265 microversion: 2.1 time: 0.183847 Aug 24 09:04:38.418755 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 510/1000] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:38 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:38.524003 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fcb48e39-d273-4e13-9a00-8a2bd1d4d9ce tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:38.532516 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fcb48e39-d273-4e13-9a00-8a2bd1d4d9ce tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1362 microversion: 2.1 time: 0.160702 Aug 24 09:04:38.533111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 491/1001] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:38 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:39.439798 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0d809b74-9b48-4495-b642-ed3bb90851c1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:39.440414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0d809b74-9b48-4495-b642-ed3bb90851c1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:39.447703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0d809b74-9b48-4495-b642-ed3bb90851c1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:39.448187 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0d809b74-9b48-4495-b642-ed3bb90851c1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:39.448841 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0d809b74-9b48-4495-b642-ed3bb90851c1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:39.449515 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0d809b74-9b48-4495-b642-ed3bb90851c1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:39.449972 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0d809b74-9b48-4495-b642-ed3bb90851c1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:39.450398 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0d809b74-9b48-4495-b642-ed3bb90851c1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:39.553528 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-be7c3dd8-06df-4d78-bd2b-f4cc720c4b84 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:39.554265 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-be7c3dd8-06df-4d78-bd2b-f4cc720c4b84 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:39.560741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be7c3dd8-06df-4d78-bd2b-f4cc720c4b84 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:39.565444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be7c3dd8-06df-4d78-bd2b-f4cc720c4b84 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:39.565444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be7c3dd8-06df-4d78-bd2b-f4cc720c4b84 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:39.565444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be7c3dd8-06df-4d78-bd2b-f4cc720c4b84 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:39.565444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be7c3dd8-06df-4d78-bd2b-f4cc720c4b84 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:39.565870 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-be7c3dd8-06df-4d78-bd2b-f4cc720c4b84 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:39.591675 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0d809b74-9b48-4495-b642-ed3bb90851c1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:39.599550 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0d809b74-9b48-4495-b642-ed3bb90851c1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1265 microversion: 2.1 time: 0.163876 Aug 24 09:04:39.600119 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 511/1002] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:39 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:39.721530 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-be7c3dd8-06df-4d78-bd2b-f4cc720c4b84 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:39.736872 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-be7c3dd8-06df-4d78-bd2b-f4cc720c4b84 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1362 microversion: 2.1 time: 0.187153 Aug 24 09:04:39.738005 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 492/1003] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:39 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:39.976366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-bde9a39e-f8a4-4da6-813e-cb8f5e425717 req-7674c864-8a91-44fb-9e69-f50c62b64ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b018901-74c5-4165-9944-187550602e1b", "name": "network-vif-plugged", "status": "completed", "tag": "9b0a2310-da6c-4502-994f-28bf901ef586"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:39.989897 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-bde9a39e-f8a4-4da6-813e-cb8f5e425717 req-7674c864-8a91-44fb-9e69-f50c62b64ec1 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:39.990723 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-bde9a39e-f8a4-4da6-813e-cb8f5e425717 req-7674c864-8a91-44fb-9e69-f50c62b64ec1 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:39.991398 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-bde9a39e-f8a4-4da6-813e-cb8f5e425717 req-7674c864-8a91-44fb-9e69-f50c62b64ec1 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:40.004933 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-bde9a39e-f8a4-4da6-813e-cb8f5e425717 req-7674c864-8a91-44fb-9e69-f50c62b64ec1 service nova] Creating event network-vif-plugged:9b0a2310-da6c-4502-994f-28bf901ef586 for instance 3b018901-74c5-4165-9944-187550602e1b on hv-cinder-85221 Aug 24 09:04:40.010777 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-bde9a39e-f8a4-4da6-813e-cb8f5e425717 req-7674c864-8a91-44fb-9e69-f50c62b64ec1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044570 Aug 24 09:04:40.018748 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 512/1004] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:04:40.621146 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-726d0e0e-7949-4007-bc76-5ed26125cbdd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:40.621753 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-726d0e0e-7949-4007-bc76-5ed26125cbdd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:40.628973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-726d0e0e-7949-4007-bc76-5ed26125cbdd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:40.629470 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-726d0e0e-7949-4007-bc76-5ed26125cbdd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:40.629903 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-726d0e0e-7949-4007-bc76-5ed26125cbdd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:40.630616 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-726d0e0e-7949-4007-bc76-5ed26125cbdd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:40.631178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-726d0e0e-7949-4007-bc76-5ed26125cbdd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:40.631551 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-726d0e0e-7949-4007-bc76-5ed26125cbdd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:40.759825 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3b9dccf4-7d5f-46a2-bdf4-c14d0cc37604 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:40.760637 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3b9dccf4-7d5f-46a2-bdf4-c14d0cc37604 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:40.767310 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b9dccf4-7d5f-46a2-bdf4-c14d0cc37604 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:40.767809 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b9dccf4-7d5f-46a2-bdf4-c14d0cc37604 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:40.768241 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b9dccf4-7d5f-46a2-bdf4-c14d0cc37604 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:40.768993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b9dccf4-7d5f-46a2-bdf4-c14d0cc37604 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:40.770255 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b9dccf4-7d5f-46a2-bdf4-c14d0cc37604 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:40.770533 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3b9dccf4-7d5f-46a2-bdf4-c14d0cc37604 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:40.816230 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-726d0e0e-7949-4007-bc76-5ed26125cbdd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:40.824972 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-726d0e0e-7949-4007-bc76-5ed26125cbdd tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1265 microversion: 2.1 time: 0.207570 Aug 24 09:04:40.825591 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 493/1005] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:40 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:40.958322 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3b9dccf4-7d5f-46a2-bdf4-c14d0cc37604 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:40.967433 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3b9dccf4-7d5f-46a2-bdf4-c14d0cc37604 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1362 microversion: 2.1 time: 0.212051 Aug 24 09:04:40.968599 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 513/1006] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:40 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:41.857676 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-aec49057-1cc5-4c17-9fbb-8ea6964e7bbb tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:41.858325 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-aec49057-1cc5-4c17-9fbb-8ea6964e7bbb tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:41.860325 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:41.861013 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=16 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:41.866236 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aec49057-1cc5-4c17-9fbb-8ea6964e7bbb tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:41.867341 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aec49057-1cc5-4c17-9fbb-8ea6964e7bbb tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:41.872615 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aec49057-1cc5-4c17-9fbb-8ea6964e7bbb tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:41.872615 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aec49057-1cc5-4c17-9fbb-8ea6964e7bbb tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:41.872615 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aec49057-1cc5-4c17-9fbb-8ea6964e7bbb tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:41.872615 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-aec49057-1cc5-4c17-9fbb-8ea6964e7bbb tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:41.990572 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b1438a76-063e-4765-abc4-93dd4e947aee tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:41.994359 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b1438a76-063e-4765-abc4-93dd4e947aee tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:41.994359 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:41.998815 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b1438a76-063e-4765-abc4-93dd4e947aee tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:41.999307 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b1438a76-063e-4765-abc4-93dd4e947aee tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:41.999738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b1438a76-063e-4765-abc4-93dd4e947aee tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:42.000442 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b1438a76-063e-4765-abc4-93dd4e947aee tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:42.000925 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b1438a76-063e-4765-abc4-93dd4e947aee tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:42.001347 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b1438a76-063e-4765-abc4-93dd4e947aee tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:42.036215 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-aec49057-1cc5-4c17-9fbb-8ea6964e7bbb tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:42.045631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-aec49057-1cc5-4c17-9fbb-8ea6964e7bbb tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1265 microversion: 2.1 time: 0.191969 Aug 24 09:04:42.046712 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 494/1007] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:41 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:42.165106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b1438a76-063e-4765-abc4-93dd4e947aee tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:42.176411 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b1438a76-063e-4765-abc4-93dd4e947aee tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1362 microversion: 2.1 time: 0.189675 Aug 24 09:04:42.177043 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 514/1008] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:41 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:43.073092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d175b7f4-70f5-4a88-bd31-2bc5f2180958 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:43.076151 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d175b7f4-70f5-4a88-bd31-2bc5f2180958 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:43.090753 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d175b7f4-70f5-4a88-bd31-2bc5f2180958 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.091632 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d175b7f4-70f5-4a88-bd31-2bc5f2180958 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.092416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d175b7f4-70f5-4a88-bd31-2bc5f2180958 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.093667 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d175b7f4-70f5-4a88-bd31-2bc5f2180958 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.094532 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d175b7f4-70f5-4a88-bd31-2bc5f2180958 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.095306 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d175b7f4-70f5-4a88-bd31-2bc5f2180958 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.200794 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d7388b7c-d01a-44ce-8382-da6a2dae2ce1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:43.201502 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d7388b7c-d01a-44ce-8382-da6a2dae2ce1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:43.210387 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d7388b7c-d01a-44ce-8382-da6a2dae2ce1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.211434 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d7388b7c-d01a-44ce-8382-da6a2dae2ce1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.211894 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d7388b7c-d01a-44ce-8382-da6a2dae2ce1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.212643 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d7388b7c-d01a-44ce-8382-da6a2dae2ce1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.213098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d7388b7c-d01a-44ce-8382-da6a2dae2ce1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.213594 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d7388b7c-d01a-44ce-8382-da6a2dae2ce1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.264640 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d175b7f4-70f5-4a88-bd31-2bc5f2180958 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:43.274091 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d175b7f4-70f5-4a88-bd31-2bc5f2180958 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1451 microversion: 2.1 time: 0.209562 Aug 24 09:04:43.275033 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 495/1009] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:43 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1451 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:43.299131 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f200b825-e0fe-4320-952c-919344a85271 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:43.300196 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f200b825-e0fe-4320-952c-919344a85271 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:43.307140 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f200b825-e0fe-4320-952c-919344a85271 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.307707 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f200b825-e0fe-4320-952c-919344a85271 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.309061 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f200b825-e0fe-4320-952c-919344a85271 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.309943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f200b825-e0fe-4320-952c-919344a85271 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.310480 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f200b825-e0fe-4320-952c-919344a85271 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.310910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f200b825-e0fe-4320-952c-919344a85271 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.401122 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d7388b7c-d01a-44ce-8382-da6a2dae2ce1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:43.410049 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d7388b7c-d01a-44ce-8382-da6a2dae2ce1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1362 microversion: 2.1 time: 0.213913 Aug 24 09:04:43.410666 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 515/1010] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:43 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:43.524957 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f200b825-e0fe-4320-952c-919344a85271 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:43.538038 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f200b825-e0fe-4320-952c-919344a85271 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1451 microversion: 2.1 time: 0.243690 Aug 24 09:04:43.539735 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 496/1011] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:43 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1451 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:44.185431 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-3290c845-b043-4c06-9007-8e5fb2645c29 req-d2626052-e674-46bc-b226-a6ff7c112f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3a6687-812a-4169-96f5-0e7e9f3af30f", "name": "network-vif-plugged", "status": "completed", "tag": "4e7b91b0-5780-4eab-adff-f304152da4c2"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:44.217447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-3290c845-b043-4c06-9007-8e5fb2645c29 req-d2626052-e674-46bc-b226-a6ff7c112f94 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:44.218607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-3290c845-b043-4c06-9007-8e5fb2645c29 req-d2626052-e674-46bc-b226-a6ff7c112f94 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:44.219254 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-3290c845-b043-4c06-9007-8e5fb2645c29 req-d2626052-e674-46bc-b226-a6ff7c112f94 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:44.233757 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-3290c845-b043-4c06-9007-8e5fb2645c29 req-d2626052-e674-46bc-b226-a6ff7c112f94 service nova] Creating event network-vif-plugged:4e7b91b0-5780-4eab-adff-f304152da4c2 for instance db3a6687-812a-4169-96f5-0e7e9f3af30f on hv-cinder-85221 Aug 24 09:04:44.240970 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-3290c845-b043-4c06-9007-8e5fb2645c29 req-d2626052-e674-46bc-b226-a6ff7c112f94 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061249 Aug 24 09:04:44.242061 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 516/1012] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:04:44.441499 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9333b56e-4dd3-4832-9488-a8efd0a0dff9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:44.446562 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9333b56e-4dd3-4832-9488-a8efd0a0dff9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:44.454197 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9333b56e-4dd3-4832-9488-a8efd0a0dff9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:44.455765 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9333b56e-4dd3-4832-9488-a8efd0a0dff9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:44.456354 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9333b56e-4dd3-4832-9488-a8efd0a0dff9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:44.457149 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9333b56e-4dd3-4832-9488-a8efd0a0dff9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:44.457655 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9333b56e-4dd3-4832-9488-a8efd0a0dff9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:44.458079 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9333b56e-4dd3-4832-9488-a8efd0a0dff9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:44.522664 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:44.703472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9333b56e-4dd3-4832-9488-a8efd0a0dff9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:44.715750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9333b56e-4dd3-4832-9488-a8efd0a0dff9 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1362 microversion: 2.1 time: 0.277963 Aug 24 09:04:44.733577 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 497/1013] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:44 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:45.744626 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-ecfb0556-ece2-4eef-b44b-9e9188793af1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:45.745437 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-ecfb0556-ece2-4eef-b44b-9e9188793af1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:45.752512 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ecfb0556-ece2-4eef-b44b-9e9188793af1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:45.753038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ecfb0556-ece2-4eef-b44b-9e9188793af1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:45.753477 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ecfb0556-ece2-4eef-b44b-9e9188793af1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:45.754197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ecfb0556-ece2-4eef-b44b-9e9188793af1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:45.754651 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ecfb0556-ece2-4eef-b44b-9e9188793af1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:45.755146 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-ecfb0556-ece2-4eef-b44b-9e9188793af1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:45.966576 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-ecfb0556-ece2-4eef-b44b-9e9188793af1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:45.974922 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-ecfb0556-ece2-4eef-b44b-9e9188793af1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1362 microversion: 2.1 time: 0.235214 Aug 24 09:04:45.975508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 517/1014] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:45 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:46.206562 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-41376e72-cb72-4442-998d-05d9704ff084 req-cff7db71-3f0b-47a4-9358-3b7797250b64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b018901-74c5-4165-9944-187550602e1b", "tag": "9b0a2310-da6c-4502-994f-28bf901ef586"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:46.220444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-41376e72-cb72-4442-998d-05d9704ff084 req-cff7db71-3f0b-47a4-9358-3b7797250b64 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:46.221137 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-41376e72-cb72-4442-998d-05d9704ff084 req-cff7db71-3f0b-47a4-9358-3b7797250b64 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:46.221655 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-41376e72-cb72-4442-998d-05d9704ff084 req-cff7db71-3f0b-47a4-9358-3b7797250b64 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:46.234731 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-41376e72-cb72-4442-998d-05d9704ff084 req-cff7db71-3f0b-47a4-9358-3b7797250b64 service nova] Creating event network-changed:9b0a2310-da6c-4502-994f-28bf901ef586 for instance 3b018901-74c5-4165-9944-187550602e1b on hv-cinder-85221 Aug 24 09:04:46.240497 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-41376e72-cb72-4442-998d-05d9704ff084 req-cff7db71-3f0b-47a4-9358-3b7797250b64 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041562 Aug 24 09:04:46.241152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 498/1015] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:47.001413 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-27aff72f-c519-4f7f-ad4f-20280c07c9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:47.002306 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-27aff72f-c519-4f7f-ad4f-20280c07c9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:47.010822 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27aff72f-c519-4f7f-ad4f-20280c07c9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:47.013181 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27aff72f-c519-4f7f-ad4f-20280c07c9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:47.013181 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27aff72f-c519-4f7f-ad4f-20280c07c9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:47.013181 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27aff72f-c519-4f7f-ad4f-20280c07c9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:47.013181 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27aff72f-c519-4f7f-ad4f-20280c07c9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:47.013894 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-27aff72f-c519-4f7f-ad4f-20280c07c9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:47.172607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-27aff72f-c519-4f7f-ad4f-20280c07c9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:47.183775 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-27aff72f-c519-4f7f-ad4f-20280c07c9a3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1362 microversion: 2.1 time: 0.188854 Aug 24 09:04:47.184710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 518/1016] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:46 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:48.219840 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-637741b2-adb0-4b74-a3d8-6dc517e9e4e3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:48.220648 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-637741b2-adb0-4b74-a3d8-6dc517e9e4e3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:48.227906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-637741b2-adb0-4b74-a3d8-6dc517e9e4e3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:48.228388 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-637741b2-adb0-4b74-a3d8-6dc517e9e4e3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:48.228845 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-637741b2-adb0-4b74-a3d8-6dc517e9e4e3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:48.229551 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-637741b2-adb0-4b74-a3d8-6dc517e9e4e3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:48.229996 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-637741b2-adb0-4b74-a3d8-6dc517e9e4e3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:48.230416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-637741b2-adb0-4b74-a3d8-6dc517e9e4e3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:48.412946 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-637741b2-adb0-4b74-a3d8-6dc517e9e4e3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:48.419027 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-637741b2-adb0-4b74-a3d8-6dc517e9e4e3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1548 microversion: 2.1 time: 0.204809 Aug 24 09:04:48.428349 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 499/1017] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:48 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1548 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:48.440454 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c12fb5b3-e92b-438d-a030-2a26d946329e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:48.441071 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c12fb5b3-e92b-438d-a030-2a26d946329e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:48.448766 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c12fb5b3-e92b-438d-a030-2a26d946329e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:48.449491 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c12fb5b3-e92b-438d-a030-2a26d946329e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:48.449696 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c12fb5b3-e92b-438d-a030-2a26d946329e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:48.450408 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c12fb5b3-e92b-438d-a030-2a26d946329e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:48.450858 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c12fb5b3-e92b-438d-a030-2a26d946329e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:48.451281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c12fb5b3-e92b-438d-a030-2a26d946329e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:48.471113 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:48.543511 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c12fb5b3-e92b-438d-a030-2a26d946329e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107008 Aug 24 09:04:48.544208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 519/1018] 10.222.0.55 () {58 vars in 1275 bytes} [Wed Aug 24 09:04:48 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:49.619533 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-54e3ac97-add9-4622-a87b-765e298c030b req-9b6a374f-0ddb-4696-8d73-a0d7154436cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db3a6687-812a-4169-96f5-0e7e9f3af30f", "tag": "4e7b91b0-5780-4eab-adff-f304152da4c2"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:49.630424 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-54e3ac97-add9-4622-a87b-765e298c030b req-9b6a374f-0ddb-4696-8d73-a0d7154436cf service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:49.631105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-54e3ac97-add9-4622-a87b-765e298c030b req-9b6a374f-0ddb-4696-8d73-a0d7154436cf service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:49.632145 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-54e3ac97-add9-4622-a87b-765e298c030b req-9b6a374f-0ddb-4696-8d73-a0d7154436cf service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:49.644575 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-54e3ac97-add9-4622-a87b-765e298c030b req-9b6a374f-0ddb-4696-8d73-a0d7154436cf service nova] Creating event network-changed:4e7b91b0-5780-4eab-adff-f304152da4c2 for instance db3a6687-812a-4169-96f5-0e7e9f3af30f on hv-cinder-85221 Aug 24 09:04:49.650800 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-54e3ac97-add9-4622-a87b-765e298c030b req-9b6a374f-0ddb-4696-8d73-a0d7154436cf service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034903 Aug 24 09:04:49.651847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 500/1019] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:05:12.830201 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:12.834345 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2bd526e7-6e34-497d-9cca-ad56a2e80344 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-327348024"}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:12.834878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2bd526e7-6e34-497d-9cca-ad56a2e80344 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:12.841295 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2bd526e7-6e34-497d-9cca-ad56a2e80344 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:12.843111 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2bd526e7-6e34-497d-9cca-ad56a2e80344 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:12.843111 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2bd526e7-6e34-497d-9cca-ad56a2e80344 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:12.843111 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2bd526e7-6e34-497d-9cca-ad56a2e80344 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:12.843575 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2bd526e7-6e34-497d-9cca-ad56a2e80344 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:12.843834 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2bd526e7-6e34-497d-9cca-ad56a2e80344 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:12.981490 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.network.security_group_api [None req-2bd526e7-6e34-497d-9cca-ad56a2e80344 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Removing security group cdac2a92-65ed-40a1-b242-d2b2b7307af2 from port 8ded112a-e184-4f96-9bf7-0ce179e1f278 Aug 24 09:05:13.622293 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2bd526e7-6e34-497d-9cca-ad56a2e80344 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "POST /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/action" status: 202 len: 0 microversion: 2.1 time: 0.793478 Aug 24 09:05:13.623121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 520/1020] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 09:05:12 2022] POST /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/action => generated 0 bytes in 795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:05:13.634301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-e461c81d-45f0-4706-a805-58bdfc5bbb73 req-91e3ed21-81a5-409b-9bb3-a30c6e29ec73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc47a1d8-3769-47c2-b88d-3b75b26eddce", "tag": "8ded112a-e184-4f96-9bf7-0ce179e1f278"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:13.645406 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=25 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:13.646288 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=12 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:13.661489 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e461c81d-45f0-4706-a805-58bdfc5bbb73 req-91e3ed21-81a5-409b-9bb3-a30c6e29ec73 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:13.673383 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e461c81d-45f0-4706-a805-58bdfc5bbb73 req-91e3ed21-81a5-409b-9bb3-a30c6e29ec73 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:13.674167 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-e461c81d-45f0-4706-a805-58bdfc5bbb73 req-91e3ed21-81a5-409b-9bb3-a30c6e29ec73 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:13.691929 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-e461c81d-45f0-4706-a805-58bdfc5bbb73 req-91e3ed21-81a5-409b-9bb3-a30c6e29ec73 service nova] Creating event network-changed:8ded112a-e184-4f96-9bf7-0ce179e1f278 for instance fc47a1d8-3769-47c2-b88d-3b75b26eddce on hv-cinder-85221 Aug 24 09:05:13.697581 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-e461c81d-45f0-4706-a805-58bdfc5bbb73 req-91e3ed21-81a5-409b-9bb3-a30c6e29ec73 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068287 Aug 24 09:05:13.698580 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 501/1021] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:05:15.083011 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-41d2caf5-b2da-48f3-b1e7-e12911ca5eb5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:15.083569 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-41d2caf5-b2da-48f3-b1e7-e12911ca5eb5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:15.090852 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41d2caf5-b2da-48f3-b1e7-e12911ca5eb5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:15.091346 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41d2caf5-b2da-48f3-b1e7-e12911ca5eb5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:15.096146 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41d2caf5-b2da-48f3-b1e7-e12911ca5eb5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:15.096146 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41d2caf5-b2da-48f3-b1e7-e12911ca5eb5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:15.096146 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41d2caf5-b2da-48f3-b1e7-e12911ca5eb5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:15.096146 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-41d2caf5-b2da-48f3-b1e7-e12911ca5eb5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:15.187554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-41d2caf5-b2da-48f3-b1e7-e12911ca5eb5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lazy-loading 'services' on Instance uuid fc47a1d8-3769-47c2-b88d-3b75b26eddce {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:05:15.456041 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-41d2caf5-b2da-48f3-b1e7-e12911ca5eb5 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/os-volume_attachments/90dacc93-ee43-44f2-9884-0f1be951c7e6" status: 202 len: 0 microversion: 2.1 time: 0.377740 Aug 24 09:05:15.456690 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 521/1022] 10.222.0.55 () {58 vars in 1416 bytes} [Wed Aug 24 09:05:15 2022] DELETE /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/os-volume_attachments/90dacc93-ee43-44f2-9884-0f1be951c7e6 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:05:15.473958 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d039c373-7d0e-49e8-83ff-262ef4b32cbc tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:15.478084 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d039c373-7d0e-49e8-83ff-262ef4b32cbc tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:15.492326 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d039c373-7d0e-49e8-83ff-262ef4b32cbc tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:15.493244 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d039c373-7d0e-49e8-83ff-262ef4b32cbc tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:15.494102 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d039c373-7d0e-49e8-83ff-262ef4b32cbc tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:15.495454 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d039c373-7d0e-49e8-83ff-262ef4b32cbc tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:15.496361 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d039c373-7d0e-49e8-83ff-262ef4b32cbc tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:15.497175 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d039c373-7d0e-49e8-83ff-262ef4b32cbc tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:15.534807 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d039c373-7d0e-49e8-83ff-262ef4b32cbc tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070170 Aug 24 09:05:15.535423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 502/1023] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:05:15 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:05:15.719038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-493a1770-6731-4e86-b571-c56f30874a8d req-0ffe7298-3277-4f7f-a1d1-33fd52239090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc47a1d8-3769-47c2-b88d-3b75b26eddce", "tag": "8ded112a-e184-4f96-9bf7-0ce179e1f278"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:15.729426 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-493a1770-6731-4e86-b571-c56f30874a8d req-0ffe7298-3277-4f7f-a1d1-33fd52239090 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:15.730021 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-493a1770-6731-4e86-b571-c56f30874a8d req-0ffe7298-3277-4f7f-a1d1-33fd52239090 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:15.730465 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-493a1770-6731-4e86-b571-c56f30874a8d req-0ffe7298-3277-4f7f-a1d1-33fd52239090 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:15.743174 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-493a1770-6731-4e86-b571-c56f30874a8d req-0ffe7298-3277-4f7f-a1d1-33fd52239090 service nova] Creating event network-changed:8ded112a-e184-4f96-9bf7-0ce179e1f278 for instance fc47a1d8-3769-47c2-b88d-3b75b26eddce on hv-cinder-85221 Aug 24 09:05:15.748783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-493a1770-6731-4e86-b571-c56f30874a8d req-0ffe7298-3277-4f7f-a1d1-33fd52239090 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033737 Aug 24 09:05:15.749390 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 522/1024] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:05:16.548902 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e446a91c-1283-44e9-9342-e1bd0a455139 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:16.551303 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e446a91c-1283-44e9-9342-e1bd0a455139 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:16.558082 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e446a91c-1283-44e9-9342-e1bd0a455139 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:16.558570 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e446a91c-1283-44e9-9342-e1bd0a455139 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:16.559199 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e446a91c-1283-44e9-9342-e1bd0a455139 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:16.559916 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e446a91c-1283-44e9-9342-e1bd0a455139 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:16.560368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e446a91c-1283-44e9-9342-e1bd0a455139 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:16.560870 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e446a91c-1283-44e9-9342-e1bd0a455139 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:16.594750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e446a91c-1283-44e9-9342-e1bd0a455139 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049905 Aug 24 09:05:16.599841 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 503/1025] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:05:16 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:05:17.609134 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f463bf77-67c7-4470-bc72-b45973888424 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:17.611608 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f463bf77-67c7-4470-bc72-b45973888424 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:17.622208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f463bf77-67c7-4470-bc72-b45973888424 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:17.622697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f463bf77-67c7-4470-bc72-b45973888424 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:17.623133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f463bf77-67c7-4470-bc72-b45973888424 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:17.625507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f463bf77-67c7-4470-bc72-b45973888424 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:17.626087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f463bf77-67c7-4470-bc72-b45973888424 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:17.626684 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f463bf77-67c7-4470-bc72-b45973888424 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:17.658404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f463bf77-67c7-4470-bc72-b45973888424 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053891 Aug 24 09:05:17.658982 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 523/1026] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:05:17 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:05:17.669930 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ece562cd-5f6f-4239-af83-568eea9aa792 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:17.670522 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ece562cd-5f6f-4239-af83-568eea9aa792 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:17.680327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ece562cd-5f6f-4239-af83-568eea9aa792 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:17.680327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ece562cd-5f6f-4239-af83-568eea9aa792 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:17.680327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ece562cd-5f6f-4239-af83-568eea9aa792 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:17.680327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ece562cd-5f6f-4239-af83-568eea9aa792 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:17.682079 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ece562cd-5f6f-4239-af83-568eea9aa792 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:17.682079 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ece562cd-5f6f-4239-af83-568eea9aa792 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:17.766103 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-ece562cd-5f6f-4239-af83-568eea9aa792 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] HTTP exception thrown: Instance fc47a1d8-3769-47c2-b88d-3b75b26eddce is not attached to volume 90dacc93-ee43-44f2-9884-0f1be951c7e6 Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ece562cd-5f6f-4239-af83-568eea9aa792 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Request method failure captured: Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: DELETE /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/os-volume_attachments/90dacc93-ee43-44f2-9884-0f1be951c7e6 HTTP/1.1 Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBejCBlrua0ymA8Uv5cB_oUlhvvMedjhkuriHdjvfxXPNFqu4kVOr9EOdjp8bFY2bHOp8JNpF0EsjL7Tf6kJIARmPBH3Q23OJqYNbQvm62Lp5-aa0cn4yfarzd1xDNi7SOCrHygBpu2_8OprZbd7X1YRkfW5qx6B_eATdKGT8i6ldjOc Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: eccd422b1e434b56ba0e0a31aebebd98 Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-TestMinimumBasicScenario-880912911 Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:05:17.768444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:05:17.770299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/eccd422b1e434b56ba0e0a31aebebd98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_eccd422b1e434b56ba0e0a31aebebd98", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/eccd422b1e434b56ba0e0a31aebebd98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/eccd422b1e434b56ba0e0a31aebebd98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:05:17.770299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-TestMinimumBasicScenario-880912911 Aug 24 09:05:17.770299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: eccd422b1e434b56ba0e0a31aebebd98 Aug 24 09:05:17.770299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-TestMinimumBasicScenario-880912911 Aug 24 09:05:17.770299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-TestMinimumBasicScenario-880912911-project Aug 24 09:05:17.770299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:05:17.770299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:05:17.770299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 095ae2b97081460da5d3da2366a604c3 Aug 24 09:05:17.770299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-TestMinimumBasicScenario-880912911-project Aug 24 09:05:17.770299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:05:17.770299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance fc47a1d8-3769-47c2-b88d-3b75b26eddce is not attached to volume 90dacc93-ee43-44f2-9884-0f1be951c7e6 Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'server_id': 'fc47a1d8-3769-47c2-b88d-3b75b26eddce', 'id': '90dacc93-ee43-44f2-9884-0f1be951c7e6'} Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 90dacc93-ee43-44f2-9884-0f1be951c7e6. Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:05:17.771331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc47a1d8-3769-47c2-b88d-3b75b26eddce is not attached to volume 90dacc93-ee43-44f2-9884-0f1be951c7e6 Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc47a1d8-3769-47c2-b88d-3b75b26eddce is not attached to volume 90dacc93-ee43-44f2-9884-0f1be951c7e6 Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:17.772874 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ece562cd-5f6f-4239-af83-568eea9aa792 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Returning 404 to user: Instance fc47a1d8-3769-47c2-b88d-3b75b26eddce is not attached to volume 90dacc93-ee43-44f2-9884-0f1be951c7e6 {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:05:17.774354 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ece562cd-5f6f-4239-af83-568eea9aa792 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/os-volume_attachments/90dacc93-ee43-44f2-9884-0f1be951c7e6" status: 404 len: 154 microversion: 2.1 time: 0.104084 Aug 24 09:05:17.774354 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 504/1027] 10.222.0.55 () {58 vars in 1416 bytes} [Wed Aug 24 09:05:17 2022] DELETE /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce/os-volume_attachments/90dacc93-ee43-44f2-9884-0f1be951c7e6 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:05:19.089250 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-aa18c1be-5ec3-4e7e-8428-d628365f4820 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:19.089929 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-aa18c1be-5ec3-4e7e-8428-d628365f4820 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:19.096989 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aa18c1be-5ec3-4e7e-8428-d628365f4820 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:19.097484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aa18c1be-5ec3-4e7e-8428-d628365f4820 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:19.097921 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aa18c1be-5ec3-4e7e-8428-d628365f4820 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:19.098644 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aa18c1be-5ec3-4e7e-8428-d628365f4820 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:19.099103 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aa18c1be-5ec3-4e7e-8428-d628365f4820 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:19.099531 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aa18c1be-5ec3-4e7e-8428-d628365f4820 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:19.129870 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-aa18c1be-5ec3-4e7e-8428-d628365f4820 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Going to try to terminate instance {{(pid=132984) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:05:19.433210 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-aa18c1be-5ec3-4e7e-8428-d628365f4820 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 204 len: 0 microversion: 2.1 time: 0.350071 Aug 24 09:05:19.433844 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 524/1028] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:05:19 2022] DELETE /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:05:19.444136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3a0b38ea-6f35-4295-99f0-63ade74424f4 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:19.444779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3a0b38ea-6f35-4295-99f0-63ade74424f4 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:19.451810 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3a0b38ea-6f35-4295-99f0-63ade74424f4 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:19.452172 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3a0b38ea-6f35-4295-99f0-63ade74424f4 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:19.452634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3a0b38ea-6f35-4295-99f0-63ade74424f4 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:19.455186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3a0b38ea-6f35-4295-99f0-63ade74424f4 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:19.455186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3a0b38ea-6f35-4295-99f0-63ade74424f4 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:19.455186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3a0b38ea-6f35-4295-99f0-63ade74424f4 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:19.595804 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3a0b38ea-6f35-4295-99f0-63ade74424f4 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:19.604474 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3a0b38ea-6f35-4295-99f0-63ade74424f4 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1554 microversion: 2.1 time: 0.164438 Aug 24 09:05:19.605074 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 505/1029] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:19 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:20.627879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0178315d-3238-4f05-8b75-d81e02e3fdbf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:20.628746 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0178315d-3238-4f05-8b75-d81e02e3fdbf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:20.635468 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0178315d-3238-4f05-8b75-d81e02e3fdbf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:20.636029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0178315d-3238-4f05-8b75-d81e02e3fdbf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:20.636786 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0178315d-3238-4f05-8b75-d81e02e3fdbf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:20.637821 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0178315d-3238-4f05-8b75-d81e02e3fdbf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:20.638448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0178315d-3238-4f05-8b75-d81e02e3fdbf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:20.639032 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0178315d-3238-4f05-8b75-d81e02e3fdbf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:20.780224 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0178315d-3238-4f05-8b75-d81e02e3fdbf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:20.789032 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0178315d-3238-4f05-8b75-d81e02e3fdbf tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1554 microversion: 2.1 time: 0.166592 Aug 24 09:05:20.789603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 525/1030] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:20 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:21.811667 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0db648ff-d0a6-45aa-ab95-89e74c922d36 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:21.812590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0db648ff-d0a6-45aa-ab95-89e74c922d36 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:21.819824 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0db648ff-d0a6-45aa-ab95-89e74c922d36 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:21.831458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0db648ff-d0a6-45aa-ab95-89e74c922d36 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:21.831921 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0db648ff-d0a6-45aa-ab95-89e74c922d36 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:21.832720 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0db648ff-d0a6-45aa-ab95-89e74c922d36 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:21.833203 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0db648ff-d0a6-45aa-ab95-89e74c922d36 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:21.833711 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0db648ff-d0a6-45aa-ab95-89e74c922d36 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:22.083812 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0db648ff-d0a6-45aa-ab95-89e74c922d36 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:22.092779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0db648ff-d0a6-45aa-ab95-89e74c922d36 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1554 microversion: 2.1 time: 0.285274 Aug 24 09:05:22.093395 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 506/1031] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:21 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1554 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:22.506209 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-baeffcbd-c070-480f-86f7-72bb75db2f1f req-621d8033-b06d-4a6c-8238-db3b17eaf1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc47a1d8-3769-47c2-b88d-3b75b26eddce", "name": "network-vif-deleted", "tag": "8ded112a-e184-4f96-9bf7-0ce179e1f278"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:22.516774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-baeffcbd-c070-480f-86f7-72bb75db2f1f req-621d8033-b06d-4a6c-8238-db3b17eaf1d6 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:22.517282 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-baeffcbd-c070-480f-86f7-72bb75db2f1f req-621d8033-b06d-4a6c-8238-db3b17eaf1d6 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:22.517711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-baeffcbd-c070-480f-86f7-72bb75db2f1f req-621d8033-b06d-4a6c-8238-db3b17eaf1d6 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:22.530107 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-baeffcbd-c070-480f-86f7-72bb75db2f1f req-621d8033-b06d-4a6c-8238-db3b17eaf1d6 service nova] Creating event network-vif-deleted:8ded112a-e184-4f96-9bf7-0ce179e1f278 for instance fc47a1d8-3769-47c2-b88d-3b75b26eddce on hv-cinder-85221 Aug 24 09:05:22.535274 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-baeffcbd-c070-480f-86f7-72bb75db2f1f req-621d8033-b06d-4a6c-8238-db3b17eaf1d6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033220 Aug 24 09:05:22.535865 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 526/1032] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:05:23.115546 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:23.116172 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:23.122964 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:23.123557 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:23.124026 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:23.124801 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:23.125254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:23.125673 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:23.157139 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:23.157459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:23.158148 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:23.158588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lazy-loading 'fault' on Instance uuid fc47a1d8-3769-47c2-b88d-3b75b26eddce {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:05:23.208178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:23.217456 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6aba05c7-7e66-4684-a1c7-3c410b43ae2c tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1349 microversion: 2.1 time: 0.105756 Aug 24 09:05:23.218118 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 507/1033] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:23 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1349 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:24.242001 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:24.242724 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:24.249087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:24.249580 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:24.250015 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:24.250715 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:24.251215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:24.251608 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:24.283382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:24.283858 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:24.284297 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:24.284775 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lazy-loading 'fault' on Instance uuid fc47a1d8-3769-47c2-b88d-3b75b26eddce {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:05:24.327157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095ae2b97081460da5d3da2366a604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd422b1e434b56ba0e0a31aebebd98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:24.335035 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-84d385a8-0175-4f1b-9e71-60bb9337d231 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 200 len: 1349 microversion: 2.1 time: 0.097684 Aug 24 09:05:24.335640 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 527/1034] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:24 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:25.356455 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e271bdf8-3aec-4d6e-984c-f98818d5d734 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:25.357009 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e271bdf8-3aec-4d6e-984c-f98818d5d734 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] [instance: fc47a1d8-3769-47c2-b88d-3b75b26eddce] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:25.363436 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e271bdf8-3aec-4d6e-984c-f98818d5d734 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:25.363908 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e271bdf8-3aec-4d6e-984c-f98818d5d734 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:25.364334 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e271bdf8-3aec-4d6e-984c-f98818d5d734 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:25.365039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e271bdf8-3aec-4d6e-984c-f98818d5d734 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:25.366117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e271bdf8-3aec-4d6e-984c-f98818d5d734 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:25.366538 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e271bdf8-3aec-4d6e-984c-f98818d5d734 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:25.379641 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-e271bdf8-3aec-4d6e-984c-f98818d5d734 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] HTTP exception thrown: Instance fc47a1d8-3769-47c2-b88d-3b75b26eddce could not be found. Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e271bdf8-3aec-4d6e-984c-f98818d5d734 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Request method failure captured: Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce HTTP/1.1 Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBejCBlrua0ymA8Uv5cB_oUlhvvMedjhkuriHdjvfxXPNFqu4kVOr9EOdjp8bFY2bHOp8JNpF0EsjL7Tf6kJIARmPBH3Q23OJqYNbQvm62Lp5-aa0cn4yfarzd1xDNi7SOCrHygBpu2_8OprZbd7X1YRkfW5qx6B_eATdKGT8i6ldjOc Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: eccd422b1e434b56ba0e0a31aebebd98 Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-TestMinimumBasicScenario-880912911 Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:05:25.381690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:05:25.383263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/eccd422b1e434b56ba0e0a31aebebd98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_eccd422b1e434b56ba0e0a31aebebd98", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/eccd422b1e434b56ba0e0a31aebebd98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/eccd422b1e434b56ba0e0a31aebebd98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:05:25.383263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-TestMinimumBasicScenario-880912911 Aug 24 09:05:25.383263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: eccd422b1e434b56ba0e0a31aebebd98 Aug 24 09:05:25.383263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-TestMinimumBasicScenario-880912911 Aug 24 09:05:25.383263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-TestMinimumBasicScenario-880912911-project Aug 24 09:05:25.383263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:05:25.383263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:05:25.383263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 095ae2b97081460da5d3da2366a604c3 Aug 24 09:05:25.383263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-TestMinimumBasicScenario-880912911-project Aug 24 09:05:25.383263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:05:25.383263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance fc47a1d8-3769-47c2-b88d-3b75b26eddce could not be found. Aug 24 09:05:25.383263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': 'fc47a1d8-3769-47c2-b88d-3b75b26eddce'} Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc47a1d8-3769-47c2-b88d-3b75b26eddce could not be found. Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:05:25.384234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc47a1d8-3769-47c2-b88d-3b75b26eddce could not be found. Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc47a1d8-3769-47c2-b88d-3b75b26eddce could not be found. Aug 24 09:05:25.385749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:25.387412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e271bdf8-3aec-4d6e-984c-f98818d5d734 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Returning 404 to user: Instance fc47a1d8-3769-47c2-b88d-3b75b26eddce could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:05:25.387412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e271bdf8-3aec-4d6e-984c-f98818d5d734 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce" status: 404 len: 111 microversion: 2.1 time: 0.030657 Aug 24 09:05:25.387412 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 508/1035] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:25 2022] GET /compute/v2.1/servers/fc47a1d8-3769-47c2-b88d-3b75b26eddce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:05:25.391889 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8cf62e7d-6d48-4abd-aa47-f69801651f17 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] Calling method '.version_select at 0x7f16ae4721f0>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:25.491819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8cf62e7d-6d48-4abd-aa47-f69801651f17 tempest-TestMinimumBasicScenario-880912911 tempest-TestMinimumBasicScenario-880912911-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1390868443" status: 202 len: 0 microversion: 2.1 time: 0.103824 Aug 24 09:05:25.492412 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 528/1036] 10.222.0.55 () {58 vars in 1272 bytes} [Wed Aug 24 09:05:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1390868443 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:05:37.670925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c3070b25-109d-4cff-90c1-f9eb86627e16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:37.671699 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c3070b25-109d-4cff-90c1-f9eb86627e16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:37.673764 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=18 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:37.674407 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=42 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:37.679408 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c3070b25-109d-4cff-90c1-f9eb86627e16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:37.680425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c3070b25-109d-4cff-90c1-f9eb86627e16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:37.680899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c3070b25-109d-4cff-90c1-f9eb86627e16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:37.681617 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c3070b25-109d-4cff-90c1-f9eb86627e16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:37.682072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c3070b25-109d-4cff-90c1-f9eb86627e16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:37.682501 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c3070b25-109d-4cff-90c1-f9eb86627e16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:37.711758 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c3070b25-109d-4cff-90c1-f9eb86627e16 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/ips" status: 200 len: 148 microversion: 2.1 time: 0.044526 Aug 24 09:05:37.719177 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 509/1037] 10.222.0.55 () {58 vars in 1248 bytes} [Wed Aug 24 09:05:37 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/ips => generated 148 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:05:40.647494 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:40.648806 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:40.653190 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a8b72502-cb41-4f23-bba8-df1226828103 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd888032-9107-427e-866f-8ad2f36ec64c"}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:40.655552 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a8b72502-cb41-4f23-bba8-df1226828103 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:40.663313 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a8b72502-cb41-4f23-bba8-df1226828103 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:40.663828 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a8b72502-cb41-4f23-bba8-df1226828103 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:40.664867 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a8b72502-cb41-4f23-bba8-df1226828103 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:40.665666 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a8b72502-cb41-4f23-bba8-df1226828103 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:40.666115 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a8b72502-cb41-4f23-bba8-df1226828103 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:40.672032 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a8b72502-cb41-4f23-bba8-df1226828103 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:42.002975 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a8b72502-cb41-4f23-bba8-df1226828103 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "POST /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.356815 Aug 24 09:05:42.009947 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 529/1038] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 09:05:40 2022] POST /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-volume_attachments => generated 194 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:05:51.147847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f8bb8544-5c34-4fd5-b469-ab33179cf32e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd888032-9107-427e-866f-8ad2f36ec64c"}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:51.154237 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f8bb8544-5c34-4fd5-b469-ab33179cf32e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:51.169824 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8bb8544-5c34-4fd5-b469-ab33179cf32e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:51.170896 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8bb8544-5c34-4fd5-b469-ab33179cf32e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:51.171664 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8bb8544-5c34-4fd5-b469-ab33179cf32e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:51.172892 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8bb8544-5c34-4fd5-b469-ab33179cf32e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:51.174133 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8bb8544-5c34-4fd5-b469-ab33179cf32e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:51.175195 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8bb8544-5c34-4fd5-b469-ab33179cf32e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:51.381233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:51.682482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-f8bb8544-5c34-4fd5-b469-ab33179cf32e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Invalid volume: volume bd888032-9107-427e-866f-8ad2f36ec64c is already attached to instances: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f8bb8544-5c34-4fd5-b469-ab33179cf32e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: POST /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-volume_attachments HTTP/1.1 Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 74 Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:05:51.686004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:05:51.687685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:05:51.687685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:05:51.687685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:05:51.687685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:05:51.687685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:05:51.687685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:05:51.687685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:05:51.687685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:05:51.687685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:05:51.687685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Aug 24 09:05:51.687685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {"volumeAttachment": {"volumeId": "bd888032-9107-427e-866f-8ad2f36ec64c"}} Aug 24 09:05:51.687685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Invalid volume: volume bd888032-9107-427e-866f-8ad2f36ec64c is already attached to instances: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'server_id': '63a4092a-a4bd-4e9d-b8f8-20b94ac1451b', 'body': {'volumeAttachment': {'volumeId': 'bd888032-9107-427e-866f-8ad2f36ec64c'}}} Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bd888032-9107-427e-866f-8ad2f36ec64c is already attached to instances: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:51.688772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bd888032-9107-427e-866f-8ad2f36ec64c is already attached to instances: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:05:51.691490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:05:51.693848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:05:51.693848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:05:51.693848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:05:51.693848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bd888032-9107-427e-866f-8ad2f36ec64c is already attached to instances: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b Aug 24 09:05:51.693848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:05:51.693848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f8bb8544-5c34-4fd5-b469-ab33179cf32e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 400 to user: Invalid volume: volume bd888032-9107-427e-866f-8ad2f36ec64c is already attached to instances: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:05:51.693848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f8bb8544-5c34-4fd5-b469-ab33179cf32e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "POST /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.553524 Aug 24 09:05:51.693848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 510/1039] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 09:05:51 2022] POST /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-volume_attachments => generated 174 bytes in 556 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:05:51.770802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b8da892e-2a77-42c3-a0be-98a74cbee199 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:51.774439 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b8da892e-2a77-42c3-a0be-98a74cbee199 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:51.797743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8da892e-2a77-42c3-a0be-98a74cbee199 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:51.799774 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8da892e-2a77-42c3-a0be-98a74cbee199 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:51.805556 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8da892e-2a77-42c3-a0be-98a74cbee199 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:51.806635 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8da892e-2a77-42c3-a0be-98a74cbee199 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:51.807222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8da892e-2a77-42c3-a0be-98a74cbee199 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:51.808168 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8da892e-2a77-42c3-a0be-98a74cbee199 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:51.850389 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9892d727-e240-4d1a-9113-8d83cbcb322d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:51.852720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9892d727-e240-4d1a-9113-8d83cbcb322d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:51.857760 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:51.869434 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9892d727-e240-4d1a-9113-8d83cbcb322d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:51.870654 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9892d727-e240-4d1a-9113-8d83cbcb322d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:51.871771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9892d727-e240-4d1a-9113-8d83cbcb322d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:51.873626 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9892d727-e240-4d1a-9113-8d83cbcb322d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:51.874989 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9892d727-e240-4d1a-9113-8d83cbcb322d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:51.876035 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9892d727-e240-4d1a-9113-8d83cbcb322d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:51.924338 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-b8da892e-2a77-42c3-a0be-98a74cbee199 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lazy-loading 'services' on Instance uuid 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:05:51.943910 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9892d727-e240-4d1a-9113-8d83cbcb322d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/ips" status: 200 len: 151 microversion: 2.20 time: 0.575816 Aug 24 09:05:51.957230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 530/1040] 10.222.0.55 () {60 vars in 1289 bytes} [Wed Aug 24 09:05:51 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/ips => generated 151 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:05:52.296397 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b8da892e-2a77-42c3-a0be-98a74cbee199 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-volume_attachments/bd888032-9107-427e-866f-8ad2f36ec64c" status: 202 len: 0 microversion: 2.1 time: 0.533874 Aug 24 09:05:52.298034 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 511/1041] 10.222.0.55 () {58 vars in 1416 bytes} [Wed Aug 24 09:05:51 2022] DELETE /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-volume_attachments/bd888032-9107-427e-866f-8ad2f36ec64c => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:05:52.311493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fe7f9bd3-4d88-43ef-a0a0-f696dba1a5b2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:52.322296 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fe7f9bd3-4d88-43ef-a0a0-f696dba1a5b2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:52.354255 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe7f9bd3-4d88-43ef-a0a0-f696dba1a5b2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:52.355166 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe7f9bd3-4d88-43ef-a0a0-f696dba1a5b2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:52.356729 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe7f9bd3-4d88-43ef-a0a0-f696dba1a5b2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:52.358497 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe7f9bd3-4d88-43ef-a0a0-f696dba1a5b2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:52.360163 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe7f9bd3-4d88-43ef-a0a0-f696dba1a5b2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:52.360960 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fe7f9bd3-4d88-43ef-a0a0-f696dba1a5b2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:52.424123 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fe7f9bd3-4d88-43ef-a0a0-f696dba1a5b2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119317 Aug 24 09:05:52.433851 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 531/1042] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:05:52 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:05:53.447788 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-34f918eb-7773-4b3c-810f-45a9db44103d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:53.452208 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-34f918eb-7773-4b3c-810f-45a9db44103d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:53.463304 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-34f918eb-7773-4b3c-810f-45a9db44103d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:53.463802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-34f918eb-7773-4b3c-810f-45a9db44103d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:53.464379 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-34f918eb-7773-4b3c-810f-45a9db44103d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:53.468361 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-34f918eb-7773-4b3c-810f-45a9db44103d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:53.469045 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-34f918eb-7773-4b3c-810f-45a9db44103d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:53.469494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-34f918eb-7773-4b3c-810f-45a9db44103d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:53.509899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-34f918eb-7773-4b3c-810f-45a9db44103d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071795 Aug 24 09:05:53.511136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 512/1043] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:05:53 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:05:53.786769 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6609a4f4-7858-4bd7-9f09-2dce6ecdb085 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Action: 'create', calling method: .version_select at 0x7f16ae4fac10>, body: {"keypair": {"name": "tempest-TestShelveInstance-2051527144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGu03izeZIoEdQ3ODyt71XBHoRD3yDdJnMEzv/nsOQC/l7X9riVpuLke9wCHXwZdQhcIcPQ5gDQQ/io2UHFjZY8oojKYVcj0u1x+zIqR+UwCoXtPxnPfJ0gSA3Z11kBEzg=="}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:53.803673 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-6609a4f4-7858-4bd7-9f09-2dce6ecdb085 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Getting quotas for project e19c750fc9af412f93ff6369e4c57730. Resources: {'key_pairs'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:05:53.808840 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-6609a4f4-7858-4bd7-9f09-2dce6ecdb085 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Getting quotas for user faf0d3eebf714e8891c6a3eebf8d87a9 and project e19c750fc9af412f93ff6369e4c57730. Resources: {'key_pairs'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:05:53.946542 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6609a4f4-7858-4bd7-9f09-2dce6ecdb085 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.326410 Aug 24 09:05:53.947863 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 532/1044] 10.222.0.55 () {60 vars in 1159 bytes} [Wed Aug 24 09:05:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:05:54.524379 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b4d4041e-15af-438b-a162-4dc743bc8152 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:54.526725 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b4d4041e-15af-438b-a162-4dc743bc8152 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:54.534863 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b4d4041e-15af-438b-a162-4dc743bc8152 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:54.535714 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b4d4041e-15af-438b-a162-4dc743bc8152 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:54.536464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b4d4041e-15af-438b-a162-4dc743bc8152 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:54.537779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b4d4041e-15af-438b-a162-4dc743bc8152 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:54.538627 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b4d4041e-15af-438b-a162-4dc743bc8152 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:54.539645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b4d4041e-15af-438b-a162-4dc743bc8152 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:54.594055 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b4d4041e-15af-438b-a162-4dc743bc8152 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074746 Aug 24 09:05:54.595315 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 513/1045] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:05:54 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:05:54.688821 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-bbd7c379-be4d-4d85-8515-fc84fee891d1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:54.689479 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-bbd7c379-be4d-4d85-8515-fc84fee891d1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:54.697948 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbd7c379-be4d-4d85-8515-fc84fee891d1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:54.698474 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbd7c379-be4d-4d85-8515-fc84fee891d1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:54.698949 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbd7c379-be4d-4d85-8515-fc84fee891d1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:54.699688 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbd7c379-be4d-4d85-8515-fc84fee891d1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:54.700149 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbd7c379-be4d-4d85-8515-fc84fee891d1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:54.700615 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbd7c379-be4d-4d85-8515-fc84fee891d1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:54.737386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-bbd7c379-be4d-4d85-8515-fc84fee891d1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Going to try to terminate instance {{(pid=132984) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:05:55.182089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-bbd7c379-be4d-4d85-8515-fc84fee891d1 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 204 len: 0 microversion: 2.1 time: 0.498274 Aug 24 09:05:55.182787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 533/1046] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:05:54 2022] DELETE /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:05:55.194332 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-277721b5-49df-4420-a742-c1a930e2032b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:55.195504 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-277721b5-49df-4420-a742-c1a930e2032b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:55.204877 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-277721b5-49df-4420-a742-c1a930e2032b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:55.205706 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-277721b5-49df-4420-a742-c1a930e2032b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:55.206463 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-277721b5-49df-4420-a742-c1a930e2032b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:55.207732 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-277721b5-49df-4420-a742-c1a930e2032b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:55.208554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-277721b5-49df-4420-a742-c1a930e2032b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:55.209342 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-277721b5-49df-4420-a742-c1a930e2032b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:55.410799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-277721b5-49df-4420-a742-c1a930e2032b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:55.423050 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-277721b5-49df-4420-a742-c1a930e2032b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1679 microversion: 2.1 time: 0.234758 Aug 24 09:05:55.424245 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 514/1047] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:55 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1679 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:55.600277 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-316b0f23-e210-4c67-b905-ec3ba28ae1f9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:55.601757 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-316b0f23-e210-4c67-b905-ec3ba28ae1f9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:55.609958 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-316b0f23-e210-4c67-b905-ec3ba28ae1f9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:55.610641 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-316b0f23-e210-4c67-b905-ec3ba28ae1f9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:55.611046 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-316b0f23-e210-4c67-b905-ec3ba28ae1f9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:55.611917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-316b0f23-e210-4c67-b905-ec3ba28ae1f9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:55.612781 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-316b0f23-e210-4c67-b905-ec3ba28ae1f9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:55.613244 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-316b0f23-e210-4c67-b905-ec3ba28ae1f9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:55.640525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-316b0f23-e210-4c67-b905-ec3ba28ae1f9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lazy-loading 'flavor' on Instance uuid 97fe50f9-e517-4e9a-80b5-6faba0b9f10a {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:05:56.292975 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-316b0f23-e210-4c67-b905-ec3ba28ae1f9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "POST /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/action" status: 202 len: 0 microversion: 2.20 time: 0.699875 Aug 24 09:05:56.295522 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 534/1048] 10.222.0.55 () {62 vars in 1319 bytes} [Wed Aug 24 09:05:55 2022] POST /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:05:56.311498 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-82193f7f-545e-4f9d-89b7-7437015f1c0a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:56.312757 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-82193f7f-545e-4f9d-89b7-7437015f1c0a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:56.327909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-82193f7f-545e-4f9d-89b7-7437015f1c0a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:56.330181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-82193f7f-545e-4f9d-89b7-7437015f1c0a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:56.330989 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-82193f7f-545e-4f9d-89b7-7437015f1c0a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:56.332747 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-82193f7f-545e-4f9d-89b7-7437015f1c0a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:56.335917 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-82193f7f-545e-4f9d-89b7-7437015f1c0a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:56.337148 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-82193f7f-545e-4f9d-89b7-7437015f1c0a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:56.465790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-51319275-92bd-4431-8c41-d9d734705b10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:56.467025 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-51319275-92bd-4431-8c41-d9d734705b10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:56.478820 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51319275-92bd-4431-8c41-d9d734705b10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:56.479613 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51319275-92bd-4431-8c41-d9d734705b10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:56.480733 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51319275-92bd-4431-8c41-d9d734705b10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:56.482324 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51319275-92bd-4431-8c41-d9d734705b10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:56.483119 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51319275-92bd-4431-8c41-d9d734705b10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:56.484010 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51319275-92bd-4431-8c41-d9d734705b10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:56.572258 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-82193f7f-545e-4f9d-89b7-7437015f1c0a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:56.605698 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-82193f7f-545e-4f9d-89b7-7437015f1c0a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:56.616365 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-82193f7f-545e-4f9d-89b7-7437015f1c0a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:56.619839 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-82193f7f-545e-4f9d-89b7-7437015f1c0a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.317218 Aug 24 09:05:56.625717 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 515/1049] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:56 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:56.776989 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-51319275-92bd-4431-8c41-d9d734705b10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:56.790499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-51319275-92bd-4431-8c41-d9d734705b10 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1679 microversion: 2.1 time: 0.331866 Aug 24 09:05:56.791426 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 535/1050] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:56 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1679 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:57.648330 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ea1a3592-2e9f-4825-aadf-0fe58e9c48cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:57.649012 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ea1a3592-2e9f-4825-aadf-0fe58e9c48cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:57.655666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ea1a3592-2e9f-4825-aadf-0fe58e9c48cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:57.656311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ea1a3592-2e9f-4825-aadf-0fe58e9c48cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:57.656791 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ea1a3592-2e9f-4825-aadf-0fe58e9c48cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:57.664300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ea1a3592-2e9f-4825-aadf-0fe58e9c48cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:57.664300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ea1a3592-2e9f-4825-aadf-0fe58e9c48cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:57.664300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ea1a3592-2e9f-4825-aadf-0fe58e9c48cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:57.823959 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-04e9ae4e-76e0-4094-b9d9-39cb8cfaebb8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:57.824887 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-04e9ae4e-76e0-4094-b9d9-39cb8cfaebb8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:57.832818 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-04e9ae4e-76e0-4094-b9d9-39cb8cfaebb8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:57.833558 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-04e9ae4e-76e0-4094-b9d9-39cb8cfaebb8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:57.834184 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-04e9ae4e-76e0-4094-b9d9-39cb8cfaebb8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:57.836511 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-04e9ae4e-76e0-4094-b9d9-39cb8cfaebb8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:57.837173 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-04e9ae4e-76e0-4094-b9d9-39cb8cfaebb8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:57.837768 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-04e9ae4e-76e0-4094-b9d9-39cb8cfaebb8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:57.914134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ea1a3592-2e9f-4825-aadf-0fe58e9c48cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:57.934261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ea1a3592-2e9f-4825-aadf-0fe58e9c48cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:57.937611 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ea1a3592-2e9f-4825-aadf-0fe58e9c48cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:57.940473 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ea1a3592-2e9f-4825-aadf-0fe58e9c48cb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.296489 Aug 24 09:05:57.961025 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 516/1051] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:57 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:58.015905 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-04e9ae4e-76e0-4094-b9d9-39cb8cfaebb8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:58.025015 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-04e9ae4e-76e0-4094-b9d9-39cb8cfaebb8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1679 microversion: 2.1 time: 0.205742 Aug 24 09:05:58.028777 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 536/1052] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:57 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:58.973930 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f7c0dd41-a28a-4edf-9c8f-3c0ba77aa270 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:58.975457 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f7c0dd41-a28a-4edf-9c8f-3c0ba77aa270 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:58.997590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f7c0dd41-a28a-4edf-9c8f-3c0ba77aa270 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:59.002479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f7c0dd41-a28a-4edf-9c8f-3c0ba77aa270 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:59.002479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f7c0dd41-a28a-4edf-9c8f-3c0ba77aa270 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:59.002479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f7c0dd41-a28a-4edf-9c8f-3c0ba77aa270 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:59.002479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f7c0dd41-a28a-4edf-9c8f-3c0ba77aa270 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:59.002920 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f7c0dd41-a28a-4edf-9c8f-3c0ba77aa270 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:59.048173 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-59daf4eb-d2e6-4658-87fc-6f1f2f174c7c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:59.049427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-59daf4eb-d2e6-4658-87fc-6f1f2f174c7c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:59.068917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-59daf4eb-d2e6-4658-87fc-6f1f2f174c7c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:59.068917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-59daf4eb-d2e6-4658-87fc-6f1f2f174c7c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:59.068917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-59daf4eb-d2e6-4658-87fc-6f1f2f174c7c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:59.078495 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-59daf4eb-d2e6-4658-87fc-6f1f2f174c7c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:59.079508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-59daf4eb-d2e6-4658-87fc-6f1f2f174c7c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:59.080399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-59daf4eb-d2e6-4658-87fc-6f1f2f174c7c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:59.234596 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-59daf4eb-d2e6-4658-87fc-6f1f2f174c7c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:59.260825 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-59daf4eb-d2e6-4658-87fc-6f1f2f174c7c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1612 microversion: 2.1 time: 0.216056 Aug 24 09:05:59.263089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 537/1053] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:59 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1612 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:59.279044 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-6021079b-730e-4bb1-84c6-279410ad5b27 req-a433e068-0207-4a1d-bc58-48bbd4ec46df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a4092a-a4bd-4e9d-b8f8-20b94ac1451b", "name": "network-vif-deleted", "tag": "bcebac0b-e063-449b-acc3-eaeffb5ab297"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:59.310301 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-6021079b-730e-4bb1-84c6-279410ad5b27 req-a433e068-0207-4a1d-bc58-48bbd4ec46df service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:59.312008 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-6021079b-730e-4bb1-84c6-279410ad5b27 req-a433e068-0207-4a1d-bc58-48bbd4ec46df service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:59.313192 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-6021079b-730e-4bb1-84c6-279410ad5b27 req-a433e068-0207-4a1d-bc58-48bbd4ec46df service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:59.343345 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-6021079b-730e-4bb1-84c6-279410ad5b27 req-a433e068-0207-4a1d-bc58-48bbd4ec46df service nova] Creating event network-vif-deleted:bcebac0b-e063-449b-acc3-eaeffb5ab297 for instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b on hv-cinder-85221 Aug 24 09:05:59.351458 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-6021079b-730e-4bb1-84c6-279410ad5b27 req-a433e068-0207-4a1d-bc58-48bbd4ec46df service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086053 Aug 24 09:05:59.352229 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 538/1054] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:05:59.353997 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f7c0dd41-a28a-4edf-9c8f-3c0ba77aa270 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:59.374483 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f7c0dd41-a28a-4edf-9c8f-3c0ba77aa270 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:59.377801 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f7c0dd41-a28a-4edf-9c8f-3c0ba77aa270 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:59.379622 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f7c0dd41-a28a-4edf-9c8f-3c0ba77aa270 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.411546 Aug 24 09:05:59.390211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 517/1055] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:58 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:00.290636 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:00.291580 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:00.298892 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:00.299390 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:00.299825 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:00.300595 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:00.301052 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:00.301583 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:00.344987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:00.345780 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:00.346379 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:00.346835 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lazy-loading 'fault' on Instance uuid 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:06:00.406653 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a03d8045-53c7-4933-b88d-e00435562e18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:00.409661 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a03d8045-53c7-4933-b88d-e00435562e18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:00.413542 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:00.419548 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a03d8045-53c7-4933-b88d-e00435562e18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:00.420065 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a03d8045-53c7-4933-b88d-e00435562e18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:00.420479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a03d8045-53c7-4933-b88d-e00435562e18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:00.421276 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a03d8045-53c7-4933-b88d-e00435562e18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:00.421747 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a03d8045-53c7-4933-b88d-e00435562e18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:00.422300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a03d8045-53c7-4933-b88d-e00435562e18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:00.443133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d95f7e91-b181-4fe6-812d-99cb8fbfa71d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 200 len: 1331 microversion: 2.1 time: 0.158367 Aug 24 09:06:00.445621 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 539/1056] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:00 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:00.656092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a03d8045-53c7-4933-b88d-e00435562e18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:00.670655 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a03d8045-53c7-4933-b88d-e00435562e18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:00.676170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a03d8045-53c7-4933-b88d-e00435562e18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:00.676170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a03d8045-53c7-4933-b88d-e00435562e18 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.272269 Aug 24 09:06:00.676170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 518/1057] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:00 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:01.466682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-814d2e3c-7d23-41ef-8ae1-41bd6da8f93b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:01.467308 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-814d2e3c-7d23-41ef-8ae1-41bd6da8f93b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:01.474001 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-814d2e3c-7d23-41ef-8ae1-41bd6da8f93b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:01.474480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-814d2e3c-7d23-41ef-8ae1-41bd6da8f93b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:01.475091 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-814d2e3c-7d23-41ef-8ae1-41bd6da8f93b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:01.476393 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-814d2e3c-7d23-41ef-8ae1-41bd6da8f93b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:01.476886 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-814d2e3c-7d23-41ef-8ae1-41bd6da8f93b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:01.477312 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-814d2e3c-7d23-41ef-8ae1-41bd6da8f93b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:01.495027 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-814d2e3c-7d23-41ef-8ae1-41bd6da8f93b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-814d2e3c-7d23-41ef-8ae1-41bd6da8f93b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b HTTP/1.1 Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:06:01.496879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:06:01.498453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:06:01.498453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:06:01.498453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:06:01.498453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:06:01.498453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:06:01.498453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:06:01.498453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:06:01.498453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:06:01.498453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:06:01.498453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:06:01.498453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:06:01.498453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '63a4092a-a4bd-4e9d-b8f8-20b94ac1451b'} Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:06:01.499302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:06:01.501012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:06:01.502463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-814d2e3c-7d23-41ef-8ae1-41bd6da8f93b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 404 to user: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:06:01.502463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-814d2e3c-7d23-41ef-8ae1-41bd6da8f93b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 404 len: 111 microversion: 2.1 time: 0.035938 Aug 24 09:06:01.502463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 540/1058] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:01 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:06:01.511156 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6b2516dd-24f1-43ae-8fec-2bf5958379f4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '.version_select at 0x7f16b2c80e50>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:01.605506 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6b2516dd-24f1-43ae-8fec-2bf5958379f4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1510326381" status: 202 len: 0 microversion: 2.1 time: 0.098482 Aug 24 09:06:01.606249 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 519/1059] 10.222.0.55 () {58 vars in 1221 bytes} [Wed Aug 24 09:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1510326381 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:06:01.699324 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3cfe5342-6a94-4d65-8fe7-c559a57e20eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:01.699966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3cfe5342-6a94-4d65-8fe7-c559a57e20eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:01.706431 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3cfe5342-6a94-4d65-8fe7-c559a57e20eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:01.707144 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3cfe5342-6a94-4d65-8fe7-c559a57e20eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:01.707482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3cfe5342-6a94-4d65-8fe7-c559a57e20eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:01.708123 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3cfe5342-6a94-4d65-8fe7-c559a57e20eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:01.708581 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3cfe5342-6a94-4d65-8fe7-c559a57e20eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:01.708996 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3cfe5342-6a94-4d65-8fe7-c559a57e20eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:01.868414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3cfe5342-6a94-4d65-8fe7-c559a57e20eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:01.877746 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3cfe5342-6a94-4d65-8fe7-c559a57e20eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:01.879285 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3cfe5342-6a94-4d65-8fe7-c559a57e20eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:01.880497 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3cfe5342-6a94-4d65-8fe7-c559a57e20eb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.185344 Aug 24 09:06:01.881070 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 541/1060] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:01 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:02.839836 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2fc735c9-5e90-412d-a985-470185ff7a0e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Action: 'create', calling method: .version_select at 0x7f16ae34d9d0>, body: {"keypair": {"name": "tempest-keypair-1632512410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4mjsOJ1l0Xjlnd2v8Kcs7uSKxpGCahPMnBFA9/K1DmU1/+gZa8AIeq0E/w6pl5xdeRQdpxTd6DLTWGrxeQt4fAH41V5ngcmS6upx0bdt2Bt8JOi7nCi/bQ7KXZDgYxFw=="}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:02.862671 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-2fc735c9-5e90-412d-a985-470185ff7a0e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for project 3809ac47fe214dda92729d4c89648a17. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:06:02.867483 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-2fc735c9-5e90-412d-a985-470185ff7a0e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for user 993697d33b7841668b1eabcdcd6b40f9 and project 3809ac47fe214dda92729d4c89648a17. Resources: {'key_pairs'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:06:02.919295 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e75e48d8-bf26-487f-8b10-ba5de981e637 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:02.920050 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e75e48d8-bf26-487f-8b10-ba5de981e637 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:02.926928 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e75e48d8-bf26-487f-8b10-ba5de981e637 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:02.927441 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e75e48d8-bf26-487f-8b10-ba5de981e637 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:02.927879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e75e48d8-bf26-487f-8b10-ba5de981e637 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:02.928638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e75e48d8-bf26-487f-8b10-ba5de981e637 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:02.929141 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e75e48d8-bf26-487f-8b10-ba5de981e637 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:02.929594 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e75e48d8-bf26-487f-8b10-ba5de981e637 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:02.994272 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2fc735c9-5e90-412d-a985-470185ff7a0e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158286 Aug 24 09:06:03.005626 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 520/1061] 10.222.0.55 () {60 vars in 1159 bytes} [Wed Aug 24 09:06:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:03.117628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e75e48d8-bf26-487f-8b10-ba5de981e637 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:03.126773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e75e48d8-bf26-487f-8b10-ba5de981e637 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:03.128328 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e75e48d8-bf26-487f-8b10-ba5de981e637 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:03.129570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e75e48d8-bf26-487f-8b10-ba5de981e637 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.214993 Aug 24 09:06:03.130252 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 542/1062] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:02 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:06:04.157750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b359aa00-61ef-482f-b962-26ada4fc5bb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:04.158643 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b359aa00-61ef-482f-b962-26ada4fc5bb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:04.165807 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b359aa00-61ef-482f-b962-26ada4fc5bb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:04.166308 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b359aa00-61ef-482f-b962-26ada4fc5bb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:04.166739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b359aa00-61ef-482f-b962-26ada4fc5bb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:04.167446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b359aa00-61ef-482f-b962-26ada4fc5bb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:04.167897 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b359aa00-61ef-482f-b962-26ada4fc5bb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:04.168314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b359aa00-61ef-482f-b962-26ada4fc5bb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:04.381425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b359aa00-61ef-482f-b962-26ada4fc5bb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:04.398466 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b359aa00-61ef-482f-b962-26ada4fc5bb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:04.401577 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b359aa00-61ef-482f-b962-26ada4fc5bb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:04.403861 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b359aa00-61ef-482f-b962-26ada4fc5bb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.251906 Aug 24 09:06:04.405209 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 521/1063] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:04 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:05.447104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-57d532a1-fb3e-4b34-b48d-782376114e5f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:05.448016 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-57d532a1-fb3e-4b34-b48d-782376114e5f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:05.450153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=4 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:05.456097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57d532a1-fb3e-4b34-b48d-782376114e5f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:05.456704 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57d532a1-fb3e-4b34-b48d-782376114e5f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:05.457037 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57d532a1-fb3e-4b34-b48d-782376114e5f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:05.457892 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57d532a1-fb3e-4b34-b48d-782376114e5f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:05.458629 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57d532a1-fb3e-4b34-b48d-782376114e5f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:05.459091 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-57d532a1-fb3e-4b34-b48d-782376114e5f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:05.610416 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-57d532a1-fb3e-4b34-b48d-782376114e5f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:05.618864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-57d532a1-fb3e-4b34-b48d-782376114e5f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:05.621369 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-57d532a1-fb3e-4b34-b48d-782376114e5f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:05.621508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-57d532a1-fb3e-4b34-b48d-782376114e5f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.179949 Aug 24 09:06:05.622059 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 543/1064] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:05 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:05.742769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1487878249", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce3c3cdc-b3eb-437a-9009-2b2f1c4b657c"}], "security_groups": [{"name": "tempest-securitygroup--151848546"}], "key_name": "tempest-keypair-1632512410", "user_data": "}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:05.860130 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.network.neutron [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] validate_networks() for [('ce3c3cdc-b3eb-437a-9009-2b2f1c4b657c', None, None, None, None, None)] {{(pid=132985) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:06:06.249068 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Flavor limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:06:06.249497 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Image limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:06:06.249994 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Flavor pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:06:06.250378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Image pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:06:06.250779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:06:06.261035 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:06.261505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:06.261932 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:06.262676 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:06.263121 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:06.263538 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:06.280033 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for project 3809ac47fe214dda92729d4c89648a17. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:06:06.284236 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Getting quotas for user 993697d33b7841668b1eabcdcd6b40f9 and project 3809ac47fe214dda92729d4c89648a17. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:06:06.296823 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Going to run 1 instances... {{(pid=132985) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:06:06.299129 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:06:06.457808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d58dd4a0-6794-40dc-8a04-a31318f3d119 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.719882 Aug 24 09:06:06.458475 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 522/1065] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 09:06:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:06:06.469174 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e38ab9e5-717e-4d21-ae22-682e44a446fa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:06.469785 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e38ab9e5-717e-4d21-ae22-682e44a446fa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:06.527816 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e38ab9e5-717e-4d21-ae22-682e44a446fa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:06.544605 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e38ab9e5-717e-4d21-ae22-682e44a446fa tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1242 microversion: 2.1 time: 0.078825 Aug 24 09:06:06.545483 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 544/1066] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:06 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:06.645781 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-13c26adf-f2c1-461d-a0d0-d25ea31c31d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:06.646394 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-13c26adf-f2c1-461d-a0d0-d25ea31c31d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:06.653096 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13c26adf-f2c1-461d-a0d0-d25ea31c31d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:06.653582 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13c26adf-f2c1-461d-a0d0-d25ea31c31d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:06.654014 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13c26adf-f2c1-461d-a0d0-d25ea31c31d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:06.654783 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13c26adf-f2c1-461d-a0d0-d25ea31c31d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:06.655239 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13c26adf-f2c1-461d-a0d0-d25ea31c31d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:06.655655 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-13c26adf-f2c1-461d-a0d0-d25ea31c31d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:06.802604 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-13c26adf-f2c1-461d-a0d0-d25ea31c31d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:06.811265 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-13c26adf-f2c1-461d-a0d0-d25ea31c31d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:06.812897 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-13c26adf-f2c1-461d-a0d0-d25ea31c31d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:06.814094 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-13c26adf-f2c1-461d-a0d0-d25ea31c31d7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.172304 Aug 24 09:06:06.822704 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 523/1067] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:06 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:07.566990 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f94c7e06-cc84-4de7-8e41-f1997009f178 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:07.567612 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f94c7e06-cc84-4de7-8e41-f1997009f178 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:07.580575 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f94c7e06-cc84-4de7-8e41-f1997009f178 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:07.581080 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f94c7e06-cc84-4de7-8e41-f1997009f178 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:07.581620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f94c7e06-cc84-4de7-8e41-f1997009f178 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:07.582335 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f94c7e06-cc84-4de7-8e41-f1997009f178 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:07.582791 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f94c7e06-cc84-4de7-8e41-f1997009f178 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:07.583272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f94c7e06-cc84-4de7-8e41-f1997009f178 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:07.651374 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f94c7e06-cc84-4de7-8e41-f1997009f178 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:07.659656 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f94c7e06-cc84-4de7-8e41-f1997009f178 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1246 microversion: 2.1 time: 0.097865 Aug 24 09:06:07.660150 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 545/1068] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:07 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:07.839031 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6286821b-b9f5-4ec4-b434-d873334c4f77 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:07.840869 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6286821b-b9f5-4ec4-b434-d873334c4f77 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:07.846142 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6286821b-b9f5-4ec4-b434-d873334c4f77 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:07.846623 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6286821b-b9f5-4ec4-b434-d873334c4f77 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:07.847057 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6286821b-b9f5-4ec4-b434-d873334c4f77 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:07.847747 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6286821b-b9f5-4ec4-b434-d873334c4f77 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:07.848198 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6286821b-b9f5-4ec4-b434-d873334c4f77 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:07.848654 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6286821b-b9f5-4ec4-b434-d873334c4f77 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:07.990912 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6286821b-b9f5-4ec4-b434-d873334c4f77 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:08.002896 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6286821b-b9f5-4ec4-b434-d873334c4f77 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:08.004496 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6286821b-b9f5-4ec4-b434-d873334c4f77 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:08.008666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6286821b-b9f5-4ec4-b434-d873334c4f77 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.170661 Aug 24 09:06:08.008666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 524/1069] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:07 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:08.680860 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-bfd2465e-11c7-46a2-b08f-aabbd83f1085 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:08.681525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-bfd2465e-11c7-46a2-b08f-aabbd83f1085 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:08.688166 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bfd2465e-11c7-46a2-b08f-aabbd83f1085 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:08.688717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bfd2465e-11c7-46a2-b08f-aabbd83f1085 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:08.689157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bfd2465e-11c7-46a2-b08f-aabbd83f1085 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:08.689868 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bfd2465e-11c7-46a2-b08f-aabbd83f1085 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:08.690314 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bfd2465e-11c7-46a2-b08f-aabbd83f1085 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:08.690736 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bfd2465e-11c7-46a2-b08f-aabbd83f1085 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:08.695469 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:08.756656 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-bfd2465e-11c7-46a2-b08f-aabbd83f1085 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:08.766807 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-bfd2465e-11c7-46a2-b08f-aabbd83f1085 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1302 microversion: 2.1 time: 0.090111 Aug 24 09:06:08.767391 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 546/1070] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:08 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1302 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:09.028968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9f6433d5-9bc3-4751-be94-5f02f1610fce tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:09.029857 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9f6433d5-9bc3-4751-be94-5f02f1610fce tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:09.036838 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9f6433d5-9bc3-4751-be94-5f02f1610fce tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:09.041839 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9f6433d5-9bc3-4751-be94-5f02f1610fce tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:09.041839 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9f6433d5-9bc3-4751-be94-5f02f1610fce tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:09.041839 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9f6433d5-9bc3-4751-be94-5f02f1610fce tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:09.041839 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9f6433d5-9bc3-4751-be94-5f02f1610fce tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:09.042282 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9f6433d5-9bc3-4751-be94-5f02f1610fce tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:09.243165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9f6433d5-9bc3-4751-be94-5f02f1610fce tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:09.252044 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9f6433d5-9bc3-4751-be94-5f02f1610fce tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:09.253599 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9f6433d5-9bc3-4751-be94-5f02f1610fce tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:09.254784 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9f6433d5-9bc3-4751-be94-5f02f1610fce tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.230048 Aug 24 09:06:09.255345 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 525/1071] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:09 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:09.789133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-aefd79ad-ff38-405c-821a-74269c043d7d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:09.789743 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-aefd79ad-ff38-405c-821a-74269c043d7d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:09.796859 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aefd79ad-ff38-405c-821a-74269c043d7d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:09.797315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aefd79ad-ff38-405c-821a-74269c043d7d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:09.797741 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aefd79ad-ff38-405c-821a-74269c043d7d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:09.798432 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aefd79ad-ff38-405c-821a-74269c043d7d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:09.798872 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aefd79ad-ff38-405c-821a-74269c043d7d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:09.799290 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-aefd79ad-ff38-405c-821a-74269c043d7d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:09.937546 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-aefd79ad-ff38-405c-821a-74269c043d7d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:09.945943 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-aefd79ad-ff38-405c-821a-74269c043d7d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1367 microversion: 2.1 time: 0.161210 Aug 24 09:06:09.946528 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 547/1072] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:09 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:10.279229 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-735ad65d-87c8-4ee3-98fc-f38c67fd17d6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:10.279847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-735ad65d-87c8-4ee3-98fc-f38c67fd17d6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:10.287092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-735ad65d-87c8-4ee3-98fc-f38c67fd17d6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:10.287500 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-735ad65d-87c8-4ee3-98fc-f38c67fd17d6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:10.287934 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-735ad65d-87c8-4ee3-98fc-f38c67fd17d6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:10.288663 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-735ad65d-87c8-4ee3-98fc-f38c67fd17d6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:10.289117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-735ad65d-87c8-4ee3-98fc-f38c67fd17d6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:10.289535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-735ad65d-87c8-4ee3-98fc-f38c67fd17d6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:10.475161 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-735ad65d-87c8-4ee3-98fc-f38c67fd17d6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:10.485933 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-735ad65d-87c8-4ee3-98fc-f38c67fd17d6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:10.487476 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-735ad65d-87c8-4ee3-98fc-f38c67fd17d6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:10.488739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-735ad65d-87c8-4ee3-98fc-f38c67fd17d6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.213415 Aug 24 09:06:10.489310 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 526/1073] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:10 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:10.798506 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-187e40cb-8a5a-4f81-b0a5-4be18be8f76c req-5c266868-adbb-4ed4-be3b-c1b66c4b3bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e67a94-aad9-497d-90e2-da6f14343cf8", "tag": "94a39355-84d1-41ed-92b5-bab82d04b265"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:10.810280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-187e40cb-8a5a-4f81-b0a5-4be18be8f76c req-5c266868-adbb-4ed4-be3b-c1b66c4b3bc1 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:10.810280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-187e40cb-8a5a-4f81-b0a5-4be18be8f76c req-5c266868-adbb-4ed4-be3b-c1b66c4b3bc1 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:10.810280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-187e40cb-8a5a-4f81-b0a5-4be18be8f76c req-5c266868-adbb-4ed4-be3b-c1b66c4b3bc1 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:10.823064 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-187e40cb-8a5a-4f81-b0a5-4be18be8f76c req-5c266868-adbb-4ed4-be3b-c1b66c4b3bc1 service nova] Creating event network-changed:94a39355-84d1-41ed-92b5-bab82d04b265 for instance 84e67a94-aad9-497d-90e2-da6f14343cf8 on hv-cinder-85221 Aug 24 09:06:10.826699 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-187e40cb-8a5a-4f81-b0a5-4be18be8f76c req-5c266868-adbb-4ed4-be3b-c1b66c4b3bc1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032732 Aug 24 09:06:10.827405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 548/1074] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:10.967273 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-62a0a0a1-c46d-42db-9b13-183fd168e916 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:10.967893 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-62a0a0a1-c46d-42db-9b13-183fd168e916 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:10.973944 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-62a0a0a1-c46d-42db-9b13-183fd168e916 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:10.974422 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-62a0a0a1-c46d-42db-9b13-183fd168e916 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:10.974852 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-62a0a0a1-c46d-42db-9b13-183fd168e916 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:10.976039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-62a0a0a1-c46d-42db-9b13-183fd168e916 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:10.976488 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-62a0a0a1-c46d-42db-9b13-183fd168e916 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:10.976931 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-62a0a0a1-c46d-42db-9b13-183fd168e916 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:11.185392 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-62a0a0a1-c46d-42db-9b13-183fd168e916 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:11.188929 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:11.193540 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-62a0a0a1-c46d-42db-9b13-183fd168e916 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1367 microversion: 2.1 time: 0.230293 Aug 24 09:06:11.194309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 527/1075] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:10 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:11.514378 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-faf7a95c-ba18-4a84-af9f-0f4a0e0f2d93 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:11.515201 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-faf7a95c-ba18-4a84-af9f-0f4a0e0f2d93 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:11.521892 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-faf7a95c-ba18-4a84-af9f-0f4a0e0f2d93 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:11.522374 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-faf7a95c-ba18-4a84-af9f-0f4a0e0f2d93 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:11.523466 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-faf7a95c-ba18-4a84-af9f-0f4a0e0f2d93 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:11.524166 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-faf7a95c-ba18-4a84-af9f-0f4a0e0f2d93 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:11.524651 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-faf7a95c-ba18-4a84-af9f-0f4a0e0f2d93 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:11.525074 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-faf7a95c-ba18-4a84-af9f-0f4a0e0f2d93 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:11.674784 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-faf7a95c-ba18-4a84-af9f-0f4a0e0f2d93 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:11.683329 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-faf7a95c-ba18-4a84-af9f-0f4a0e0f2d93 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:11.684894 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-faf7a95c-ba18-4a84-af9f-0f4a0e0f2d93 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:11.686089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-faf7a95c-ba18-4a84-af9f-0f4a0e0f2d93 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.176054 Aug 24 09:06:11.686697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 549/1076] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:11 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:12.214742 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fa5a9cd9-9d52-44cd-b4ec-6863bafdcc1f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:12.215353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-fa5a9cd9-9d52-44cd-b4ec-6863bafdcc1f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:12.222142 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa5a9cd9-9d52-44cd-b4ec-6863bafdcc1f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:12.222624 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa5a9cd9-9d52-44cd-b4ec-6863bafdcc1f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:12.223056 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa5a9cd9-9d52-44cd-b4ec-6863bafdcc1f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:12.223749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa5a9cd9-9d52-44cd-b4ec-6863bafdcc1f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:12.224199 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa5a9cd9-9d52-44cd-b4ec-6863bafdcc1f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:12.224650 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa5a9cd9-9d52-44cd-b4ec-6863bafdcc1f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:12.356922 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fa5a9cd9-9d52-44cd-b4ec-6863bafdcc1f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:12.364781 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fa5a9cd9-9d52-44cd-b4ec-6863bafdcc1f tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1367 microversion: 2.1 time: 0.154216 Aug 24 09:06:12.365288 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 528/1077] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:12 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:12.711079 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-05a9ec35-e717-4b6c-ba59-6b8e61518e1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:12.711615 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-05a9ec35-e717-4b6c-ba59-6b8e61518e1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:12.718019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-05a9ec35-e717-4b6c-ba59-6b8e61518e1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:12.718492 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-05a9ec35-e717-4b6c-ba59-6b8e61518e1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:12.718917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-05a9ec35-e717-4b6c-ba59-6b8e61518e1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:12.719597 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-05a9ec35-e717-4b6c-ba59-6b8e61518e1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:12.720037 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-05a9ec35-e717-4b6c-ba59-6b8e61518e1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:12.720450 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-05a9ec35-e717-4b6c-ba59-6b8e61518e1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:12.858210 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-05a9ec35-e717-4b6c-ba59-6b8e61518e1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:12.866618 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-05a9ec35-e717-4b6c-ba59-6b8e61518e1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:12.868289 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-05a9ec35-e717-4b6c-ba59-6b8e61518e1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:12.869586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-05a9ec35-e717-4b6c-ba59-6b8e61518e1b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.163096 Aug 24 09:06:12.870146 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 550/1078] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:12 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:13.386164 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b8593846-a1cc-4d12-8e6e-d4d47532020d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:13.386803 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b8593846-a1cc-4d12-8e6e-d4d47532020d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:13.393401 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8593846-a1cc-4d12-8e6e-d4d47532020d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:13.393875 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8593846-a1cc-4d12-8e6e-d4d47532020d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:13.394302 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8593846-a1cc-4d12-8e6e-d4d47532020d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:13.394996 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8593846-a1cc-4d12-8e6e-d4d47532020d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:13.395436 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8593846-a1cc-4d12-8e6e-d4d47532020d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:13.395850 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8593846-a1cc-4d12-8e6e-d4d47532020d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:13.534670 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b8593846-a1cc-4d12-8e6e-d4d47532020d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:13.543819 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b8593846-a1cc-4d12-8e6e-d4d47532020d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1367 microversion: 2.1 time: 0.161512 Aug 24 09:06:13.544520 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 529/1079] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:13 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:13.892866 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3ae47cab-3a29-46fe-a360-6fb9d4371de9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:13.893512 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3ae47cab-3a29-46fe-a360-6fb9d4371de9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:13.900930 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ae47cab-3a29-46fe-a360-6fb9d4371de9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:13.901418 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ae47cab-3a29-46fe-a360-6fb9d4371de9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:13.901862 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ae47cab-3a29-46fe-a360-6fb9d4371de9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:13.902570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ae47cab-3a29-46fe-a360-6fb9d4371de9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:13.903034 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ae47cab-3a29-46fe-a360-6fb9d4371de9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:13.903461 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ae47cab-3a29-46fe-a360-6fb9d4371de9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:14.046256 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3ae47cab-3a29-46fe-a360-6fb9d4371de9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:14.054703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3ae47cab-3a29-46fe-a360-6fb9d4371de9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:14.056240 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3ae47cab-3a29-46fe-a360-6fb9d4371de9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:14.057507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3ae47cab-3a29-46fe-a360-6fb9d4371de9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.168749 Aug 24 09:06:14.058074 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 551/1080] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:13 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:14.564917 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a1ec45da-a6e1-4bc2-a438-e17eeffcaa26 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:14.565742 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a1ec45da-a6e1-4bc2-a438-e17eeffcaa26 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:14.573460 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1ec45da-a6e1-4bc2-a438-e17eeffcaa26 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:14.573950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1ec45da-a6e1-4bc2-a438-e17eeffcaa26 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:14.574389 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1ec45da-a6e1-4bc2-a438-e17eeffcaa26 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:14.575098 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1ec45da-a6e1-4bc2-a438-e17eeffcaa26 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:14.575553 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1ec45da-a6e1-4bc2-a438-e17eeffcaa26 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:14.576007 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a1ec45da-a6e1-4bc2-a438-e17eeffcaa26 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:14.761925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a1ec45da-a6e1-4bc2-a438-e17eeffcaa26 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:14.770120 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a1ec45da-a6e1-4bc2-a438-e17eeffcaa26 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1367 microversion: 2.1 time: 0.210052 Aug 24 09:06:14.770704 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 530/1081] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:14 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:15.081548 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b89cfdd0-13cb-4afe-936c-6021e49b000c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:15.082133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b89cfdd0-13cb-4afe-936c-6021e49b000c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:15.089124 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b89cfdd0-13cb-4afe-936c-6021e49b000c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:15.089602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b89cfdd0-13cb-4afe-936c-6021e49b000c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:15.090032 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b89cfdd0-13cb-4afe-936c-6021e49b000c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:15.090747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b89cfdd0-13cb-4afe-936c-6021e49b000c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:15.091192 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b89cfdd0-13cb-4afe-936c-6021e49b000c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:15.091618 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b89cfdd0-13cb-4afe-936c-6021e49b000c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:15.237051 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b89cfdd0-13cb-4afe-936c-6021e49b000c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:15.245394 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b89cfdd0-13cb-4afe-936c-6021e49b000c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:15.246894 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b89cfdd0-13cb-4afe-936c-6021e49b000c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:15.248055 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b89cfdd0-13cb-4afe-936c-6021e49b000c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.170447 Aug 24 09:06:15.248681 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 552/1082] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:15 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:15.791113 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-63767c5b-e4c3-4130-9ce6-839ed666e2f8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:15.791746 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-63767c5b-e4c3-4130-9ce6-839ed666e2f8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:15.798527 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-63767c5b-e4c3-4130-9ce6-839ed666e2f8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:15.799012 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-63767c5b-e4c3-4130-9ce6-839ed666e2f8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:15.799440 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-63767c5b-e4c3-4130-9ce6-839ed666e2f8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:15.800128 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-63767c5b-e4c3-4130-9ce6-839ed666e2f8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:15.800661 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-63767c5b-e4c3-4130-9ce6-839ed666e2f8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:15.801082 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-63767c5b-e4c3-4130-9ce6-839ed666e2f8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:15.943102 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-63767c5b-e4c3-4130-9ce6-839ed666e2f8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:15.951830 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-63767c5b-e4c3-4130-9ce6-839ed666e2f8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1367 microversion: 2.1 time: 0.164499 Aug 24 09:06:15.952410 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 531/1083] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:15 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:16.271562 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9dfb9e57-45c3-4c50-b957-7a19f5af6b6a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:16.272166 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9dfb9e57-45c3-4c50-b957-7a19f5af6b6a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:16.278889 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9dfb9e57-45c3-4c50-b957-7a19f5af6b6a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:16.279368 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9dfb9e57-45c3-4c50-b957-7a19f5af6b6a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:16.279801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9dfb9e57-45c3-4c50-b957-7a19f5af6b6a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:16.280501 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9dfb9e57-45c3-4c50-b957-7a19f5af6b6a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:16.280977 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9dfb9e57-45c3-4c50-b957-7a19f5af6b6a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:16.281399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9dfb9e57-45c3-4c50-b957-7a19f5af6b6a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:16.419458 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9dfb9e57-45c3-4c50-b957-7a19f5af6b6a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:16.428308 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9dfb9e57-45c3-4c50-b957-7a19f5af6b6a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:16.429880 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9dfb9e57-45c3-4c50-b957-7a19f5af6b6a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:16.431051 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9dfb9e57-45c3-4c50-b957-7a19f5af6b6a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.163402 Aug 24 09:06:16.431605 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 553/1084] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:16 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:16.972902 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9ca67d98-6f75-4d30-b20b-af4eb488808d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:16.973955 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9ca67d98-6f75-4d30-b20b-af4eb488808d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:16.975335 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:16.976022 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=10 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:16.981368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9ca67d98-6f75-4d30-b20b-af4eb488808d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:16.981845 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9ca67d98-6f75-4d30-b20b-af4eb488808d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:16.982276 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9ca67d98-6f75-4d30-b20b-af4eb488808d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:16.982961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9ca67d98-6f75-4d30-b20b-af4eb488808d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:16.983406 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9ca67d98-6f75-4d30-b20b-af4eb488808d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:16.983947 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9ca67d98-6f75-4d30-b20b-af4eb488808d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:17.120800 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9ca67d98-6f75-4d30-b20b-af4eb488808d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:17.128673 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9ca67d98-6f75-4d30-b20b-af4eb488808d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1367 microversion: 2.1 time: 0.159723 Aug 24 09:06:17.129234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 532/1085] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:16 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:17.454331 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6aa2a251-d6b6-4c69-99ab-5ced309fefe2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:17.454956 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6aa2a251-d6b6-4c69-99ab-5ced309fefe2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:17.456906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:17.462265 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6aa2a251-d6b6-4c69-99ab-5ced309fefe2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:17.462737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6aa2a251-d6b6-4c69-99ab-5ced309fefe2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:17.463167 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6aa2a251-d6b6-4c69-99ab-5ced309fefe2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:17.463886 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6aa2a251-d6b6-4c69-99ab-5ced309fefe2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:17.464308 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6aa2a251-d6b6-4c69-99ab-5ced309fefe2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:17.464753 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6aa2a251-d6b6-4c69-99ab-5ced309fefe2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:17.600697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6aa2a251-d6b6-4c69-99ab-5ced309fefe2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:17.611388 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6aa2a251-d6b6-4c69-99ab-5ced309fefe2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:17.612981 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6aa2a251-d6b6-4c69-99ab-5ced309fefe2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:17.614160 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6aa2a251-d6b6-4c69-99ab-5ced309fefe2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.163767 Aug 24 09:06:17.614730 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 554/1086] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:17 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:18.154240 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f17b2f34-c335-4ee4-8300-8c2bda7303c6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:18.156327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f17b2f34-c335-4ee4-8300-8c2bda7303c6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:18.161571 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f17b2f34-c335-4ee4-8300-8c2bda7303c6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:18.162039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f17b2f34-c335-4ee4-8300-8c2bda7303c6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:18.162472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f17b2f34-c335-4ee4-8300-8c2bda7303c6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:18.163157 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f17b2f34-c335-4ee4-8300-8c2bda7303c6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:18.164251 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f17b2f34-c335-4ee4-8300-8c2bda7303c6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:18.164725 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f17b2f34-c335-4ee4-8300-8c2bda7303c6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:18.295375 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f17b2f34-c335-4ee4-8300-8c2bda7303c6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:18.303108 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f17b2f34-c335-4ee4-8300-8c2bda7303c6 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1367 microversion: 2.1 time: 0.152841 Aug 24 09:06:18.303679 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 533/1087] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:18 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:18.639033 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8b0333eb-e070-4d9f-8d30-b65161d167f6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:18.639640 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8b0333eb-e070-4d9f-8d30-b65161d167f6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:18.646110 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8b0333eb-e070-4d9f-8d30-b65161d167f6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:18.646586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8b0333eb-e070-4d9f-8d30-b65161d167f6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:18.647016 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8b0333eb-e070-4d9f-8d30-b65161d167f6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:18.647728 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8b0333eb-e070-4d9f-8d30-b65161d167f6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:18.648184 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8b0333eb-e070-4d9f-8d30-b65161d167f6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:18.648629 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8b0333eb-e070-4d9f-8d30-b65161d167f6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:18.780275 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8b0333eb-e070-4d9f-8d30-b65161d167f6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:18.788926 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8b0333eb-e070-4d9f-8d30-b65161d167f6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:18.790436 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8b0333eb-e070-4d9f-8d30-b65161d167f6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:18.791602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8b0333eb-e070-4d9f-8d30-b65161d167f6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1745 microversion: 2.20 time: 0.156600 Aug 24 09:06:18.792177 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 555/1088] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:18 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:19.324787 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-53139d26-0f52-47ce-84c7-6761614e9eee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:19.325393 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-53139d26-0f52-47ce-84c7-6761614e9eee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:19.331789 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-53139d26-0f52-47ce-84c7-6761614e9eee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:19.332258 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-53139d26-0f52-47ce-84c7-6761614e9eee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:19.332715 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-53139d26-0f52-47ce-84c7-6761614e9eee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:19.333400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-53139d26-0f52-47ce-84c7-6761614e9eee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:19.333844 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-53139d26-0f52-47ce-84c7-6761614e9eee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:19.334265 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-53139d26-0f52-47ce-84c7-6761614e9eee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:19.468141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-53139d26-0f52-47ce-84c7-6761614e9eee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:19.476090 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-53139d26-0f52-47ce-84c7-6761614e9eee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1367 microversion: 2.1 time: 0.155190 Aug 24 09:06:19.476786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 534/1089] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:19 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:19.815523 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1c920d9e-c7d5-4201-848a-5b1bc68034e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:19.816217 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1c920d9e-c7d5-4201-848a-5b1bc68034e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:19.830413 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1c920d9e-c7d5-4201-848a-5b1bc68034e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:19.830910 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1c920d9e-c7d5-4201-848a-5b1bc68034e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:19.831348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1c920d9e-c7d5-4201-848a-5b1bc68034e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:19.832053 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1c920d9e-c7d5-4201-848a-5b1bc68034e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:19.832496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1c920d9e-c7d5-4201-848a-5b1bc68034e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:19.833119 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1c920d9e-c7d5-4201-848a-5b1bc68034e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:19.984075 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1c920d9e-c7d5-4201-848a-5b1bc68034e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:19.993280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1c920d9e-c7d5-4201-848a-5b1bc68034e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:19.995117 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1c920d9e-c7d5-4201-848a-5b1bc68034e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:19.996141 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1c920d9e-c7d5-4201-848a-5b1bc68034e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1745 microversion: 2.20 time: 0.184710 Aug 24 09:06:19.996778 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 556/1090] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:19 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:20.002552 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-17916221-f9d2-4c11-b3df-96b41ac1b8db req-9112bd73-de28-46b8-b93e-c8ed343f5418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e67a94-aad9-497d-90e2-da6f14343cf8", "name": "network-vif-plugged", "status": "completed", "tag": "94a39355-84d1-41ed-92b5-bab82d04b265"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:20.013475 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-17916221-f9d2-4c11-b3df-96b41ac1b8db req-9112bd73-de28-46b8-b93e-c8ed343f5418 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:20.013867 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-17916221-f9d2-4c11-b3df-96b41ac1b8db req-9112bd73-de28-46b8-b93e-c8ed343f5418 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:20.014464 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-17916221-f9d2-4c11-b3df-96b41ac1b8db req-9112bd73-de28-46b8-b93e-c8ed343f5418 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:20.027067 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-17916221-f9d2-4c11-b3df-96b41ac1b8db req-9112bd73-de28-46b8-b93e-c8ed343f5418 service nova] Creating event network-vif-plugged:94a39355-84d1-41ed-92b5-bab82d04b265 for instance 84e67a94-aad9-497d-90e2-da6f14343cf8 on hv-cinder-85221 Aug 24 09:06:20.032502 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-17916221-f9d2-4c11-b3df-96b41ac1b8db req-9112bd73-de28-46b8-b93e-c8ed343f5418 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034224 Aug 24 09:06:20.033189 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 557/1091] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:20.078236 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6b76f80f-29e7-4c75-8e3f-444d731a9690 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:20.078751 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6b76f80f-29e7-4c75-8e3f-444d731a9690 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:20.085804 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6b76f80f-29e7-4c75-8e3f-444d731a9690 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:20.086298 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6b76f80f-29e7-4c75-8e3f-444d731a9690 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:20.086739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6b76f80f-29e7-4c75-8e3f-444d731a9690 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:20.087442 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6b76f80f-29e7-4c75-8e3f-444d731a9690 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:20.087897 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6b76f80f-29e7-4c75-8e3f-444d731a9690 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:20.088316 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6b76f80f-29e7-4c75-8e3f-444d731a9690 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:20.113600 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6b76f80f-29e7-4c75-8e3f-444d731a9690 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/ips" status: 200 len: 146 microversion: 2.1 time: 0.230715 Aug 24 09:06:20.114100 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 535/1092] 10.222.0.55 () {58 vars in 1248 bytes} [Wed Aug 24 09:06:19 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/ips => generated 146 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:06:20.497654 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-61084003-8151-4043-8b21-6a9cc343c30a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:20.498348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-61084003-8151-4043-8b21-6a9cc343c30a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:20.505066 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61084003-8151-4043-8b21-6a9cc343c30a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:20.505548 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61084003-8151-4043-8b21-6a9cc343c30a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:20.505978 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61084003-8151-4043-8b21-6a9cc343c30a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:20.506673 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61084003-8151-4043-8b21-6a9cc343c30a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:20.507695 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61084003-8151-4043-8b21-6a9cc343c30a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:20.508116 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-61084003-8151-4043-8b21-6a9cc343c30a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:20.643838 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-61084003-8151-4043-8b21-6a9cc343c30a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:20.652233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-61084003-8151-4043-8b21-6a9cc343c30a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1367 microversion: 2.1 time: 0.158806 Aug 24 09:06:20.652836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 558/1093] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:20 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:21.018701 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0b1fd559-f473-456d-956a-9962313c879d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:21.019338 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0b1fd559-f473-456d-956a-9962313c879d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:21.025848 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0b1fd559-f473-456d-956a-9962313c879d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:21.026328 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0b1fd559-f473-456d-956a-9962313c879d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:21.026755 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0b1fd559-f473-456d-956a-9962313c879d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:21.027441 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0b1fd559-f473-456d-956a-9962313c879d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:21.027890 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0b1fd559-f473-456d-956a-9962313c879d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:21.028312 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0b1fd559-f473-456d-956a-9962313c879d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:21.160092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0b1fd559-f473-456d-956a-9962313c879d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:21.168484 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0b1fd559-f473-456d-956a-9962313c879d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:21.169995 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0b1fd559-f473-456d-956a-9962313c879d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:21.171177 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0b1fd559-f473-456d-956a-9962313c879d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1745 microversion: 2.20 time: 0.156588 Aug 24 09:06:21.171726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 536/1094] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:21 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:21.673677 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-51c00a8d-172e-45f8-8694-98524d08d0df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:21.674311 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-51c00a8d-172e-45f8-8694-98524d08d0df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:21.676823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:21.681513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51c00a8d-172e-45f8-8694-98524d08d0df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:21.681989 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51c00a8d-172e-45f8-8694-98524d08d0df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:21.682419 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51c00a8d-172e-45f8-8694-98524d08d0df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:21.683106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51c00a8d-172e-45f8-8694-98524d08d0df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:21.683559 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51c00a8d-172e-45f8-8694-98524d08d0df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:21.683982 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-51c00a8d-172e-45f8-8694-98524d08d0df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:21.818451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-51c00a8d-172e-45f8-8694-98524d08d0df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:21.826065 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-51c00a8d-172e-45f8-8694-98524d08d0df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1367 microversion: 2.1 time: 0.156265 Aug 24 09:06:21.826628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 559/1095] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:21 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:22.195201 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-914dc9dd-28fb-4880-906d-24599ad47ffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:22.195922 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-914dc9dd-28fb-4880-906d-24599ad47ffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:22.198284 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:22.203115 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-914dc9dd-28fb-4880-906d-24599ad47ffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:22.203881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-914dc9dd-28fb-4880-906d-24599ad47ffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:22.204182 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-914dc9dd-28fb-4880-906d-24599ad47ffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:22.205132 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-914dc9dd-28fb-4880-906d-24599ad47ffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:22.205791 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-914dc9dd-28fb-4880-906d-24599ad47ffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:22.206276 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-914dc9dd-28fb-4880-906d-24599ad47ffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:22.345329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-914dc9dd-28fb-4880-906d-24599ad47ffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:22.353844 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-914dc9dd-28fb-4880-906d-24599ad47ffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:22.355464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-914dc9dd-28fb-4880-906d-24599ad47ffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:22.356689 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-914dc9dd-28fb-4880-906d-24599ad47ffb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1745 microversion: 2.20 time: 0.165931 Aug 24 09:06:22.357241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 537/1096] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:22 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:22.847694 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6f652aff-d7fa-4ec0-ba78-1808d16d2294 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:22.848353 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6f652aff-d7fa-4ec0-ba78-1808d16d2294 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:22.855492 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6f652aff-d7fa-4ec0-ba78-1808d16d2294 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:22.855979 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6f652aff-d7fa-4ec0-ba78-1808d16d2294 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:22.856418 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6f652aff-d7fa-4ec0-ba78-1808d16d2294 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:22.856584 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b4066971-a6a9-4177-97be-e425289e92ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "443d072e-27a4-47b3-a35a-7051df48a2f8"}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:22.857188 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6f652aff-d7fa-4ec0-ba78-1808d16d2294 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:22.857591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6f652aff-d7fa-4ec0-ba78-1808d16d2294 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:22.858013 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6f652aff-d7fa-4ec0-ba78-1808d16d2294 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:22.859174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b4066971-a6a9-4177-97be-e425289e92ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:22.865260 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b4066971-a6a9-4177-97be-e425289e92ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:22.865785 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b4066971-a6a9-4177-97be-e425289e92ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:22.866248 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b4066971-a6a9-4177-97be-e425289e92ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:22.867593 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b4066971-a6a9-4177-97be-e425289e92ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:22.868044 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b4066971-a6a9-4177-97be-e425289e92ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:22.868465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b4066971-a6a9-4177-97be-e425289e92ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:22.996730 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6f652aff-d7fa-4ec0-ba78-1808d16d2294 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:23.004451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6f652aff-d7fa-4ec0-ba78-1808d16d2294 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1367 microversion: 2.1 time: 0.160791 Aug 24 09:06:23.005045 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 560/1097] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:22 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:23.381742 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-485178da-2328-40f6-9023-009e393d0b33 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:23.382936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-485178da-2328-40f6-9023-009e393d0b33 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:23.389496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-485178da-2328-40f6-9023-009e393d0b33 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:23.389981 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-485178da-2328-40f6-9023-009e393d0b33 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:23.390417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-485178da-2328-40f6-9023-009e393d0b33 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:23.391140 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-485178da-2328-40f6-9023-009e393d0b33 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:23.391590 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-485178da-2328-40f6-9023-009e393d0b33 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:23.392019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-485178da-2328-40f6-9023-009e393d0b33 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:23.527585 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-485178da-2328-40f6-9023-009e393d0b33 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:23.537278 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-485178da-2328-40f6-9023-009e393d0b33 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:23.539501 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-485178da-2328-40f6-9023-009e393d0b33 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:23.540713 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-485178da-2328-40f6-9023-009e393d0b33 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1745 microversion: 2.20 time: 0.163059 Aug 24 09:06:23.541277 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 561/1098] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:23 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:06:23.848927 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-a982059e-cc57-4a18-b0a8-60d0ce3af831 req-60a65bc9-5590-4786-ba33-27169c01a6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fe50f9-e517-4e9a-80b5-6faba0b9f10a", "name": "network-vif-plugged", "status": "completed", "tag": "8d40ee89-fb81-4d38-99c2-3dac67fab1b0"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:23.860935 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-a982059e-cc57-4a18-b0a8-60d0ce3af831 req-60a65bc9-5590-4786-ba33-27169c01a6b7 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:23.861410 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-a982059e-cc57-4a18-b0a8-60d0ce3af831 req-60a65bc9-5590-4786-ba33-27169c01a6b7 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:23.861838 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-a982059e-cc57-4a18-b0a8-60d0ce3af831 req-60a65bc9-5590-4786-ba33-27169c01a6b7 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:23.873662 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-a982059e-cc57-4a18-b0a8-60d0ce3af831 req-60a65bc9-5590-4786-ba33-27169c01a6b7 service nova] Creating event network-vif-plugged:8d40ee89-fb81-4d38-99c2-3dac67fab1b0 for instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a on hv-cinder-85221 Aug 24 09:06:23.878701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-a982059e-cc57-4a18-b0a8-60d0ce3af831 req-60a65bc9-5590-4786-ba33-27169c01a6b7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034358 Aug 24 09:06:23.879282 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 562/1099] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:06:24.025118 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-cee5ca25-8d56-418d-97f4-e577d8612cb9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:24.025847 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-cee5ca25-8d56-418d-97f4-e577d8612cb9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:24.032451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cee5ca25-8d56-418d-97f4-e577d8612cb9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:24.033016 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cee5ca25-8d56-418d-97f4-e577d8612cb9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:24.033711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cee5ca25-8d56-418d-97f4-e577d8612cb9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:24.034393 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cee5ca25-8d56-418d-97f4-e577d8612cb9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:24.034845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cee5ca25-8d56-418d-97f4-e577d8612cb9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:24.035268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cee5ca25-8d56-418d-97f4-e577d8612cb9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:24.059543 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b4066971-a6a9-4177-97be-e425289e92ec tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "POST /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.206867 Aug 24 09:06:24.060675 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 538/1100] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 09:06:22 2022] POST /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments => generated 194 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:24.176507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-cee5ca25-8d56-418d-97f4-e577d8612cb9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:24.185720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-cee5ca25-8d56-418d-97f4-e577d8612cb9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1556 microversion: 2.1 time: 0.165388 Aug 24 09:06:24.194351 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 563/1101] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:24 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:24.206885 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c046c63d-1f15-4d36-8cf0-f21e3c7daa60 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:24.207466 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c046c63d-1f15-4d36-8cf0-f21e3c7daa60 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:24.214846 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c046c63d-1f15-4d36-8cf0-f21e3c7daa60 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:24.215440 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c046c63d-1f15-4d36-8cf0-f21e3c7daa60 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:24.216001 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c046c63d-1f15-4d36-8cf0-f21e3c7daa60 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:24.216880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c046c63d-1f15-4d36-8cf0-f21e3c7daa60 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:24.217338 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c046c63d-1f15-4d36-8cf0-f21e3c7daa60 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:24.217764 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c046c63d-1f15-4d36-8cf0-f21e3c7daa60 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:24.299482 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c046c63d-1f15-4d36-8cf0-f21e3c7daa60 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096932 Aug 24 09:06:24.300192 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 539/1102] 10.222.0.55 () {58 vars in 1275 bytes} [Wed Aug 24 09:06:24 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:24.564770 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e2977bd6-28d0-463c-9b70-db022abfa1d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:24.565377 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e2977bd6-28d0-463c-9b70-db022abfa1d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:24.571729 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e2977bd6-28d0-463c-9b70-db022abfa1d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:24.572207 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e2977bd6-28d0-463c-9b70-db022abfa1d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:24.572727 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e2977bd6-28d0-463c-9b70-db022abfa1d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:24.573479 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e2977bd6-28d0-463c-9b70-db022abfa1d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:24.573919 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e2977bd6-28d0-463c-9b70-db022abfa1d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:24.574337 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e2977bd6-28d0-463c-9b70-db022abfa1d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:24.707543 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e2977bd6-28d0-463c-9b70-db022abfa1d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:24.711268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:24.716861 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e2977bd6-28d0-463c-9b70-db022abfa1d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:24.718404 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e2977bd6-28d0-463c-9b70-db022abfa1d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:24.719586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e2977bd6-28d0-463c-9b70-db022abfa1d4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1745 microversion: 2.20 time: 0.158806 Aug 24 09:06:24.720137 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 564/1103] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:24 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:24.837676 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1841016473", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2051527144", "security_groups": [{"name": "tempest-secgroup-smoke-702076704"}], "networks": [{"uuid": "8fdc48ee-dd53-4a3c-ad19-1dac15800f32"}], "block_device_mapping_v2": [{"uuid": "20532cd7-3c7f-48d6-85bc-55629bc3df25", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:25.237025 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.network.neutron [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] validate_networks() for [('8fdc48ee-dd53-4a3c-ad19-1dac15800f32', None, None, None, None, None)] {{(pid=132985) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:06:25.742969 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5b07670b-6f4f-4e6d-b472-5b510288f8de tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:25.743574 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5b07670b-6f4f-4e6d-b472-5b510288f8de tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:25.750318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5b07670b-6f4f-4e6d-b472-5b510288f8de tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:25.750797 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5b07670b-6f4f-4e6d-b472-5b510288f8de tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:25.751227 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5b07670b-6f4f-4e6d-b472-5b510288f8de tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:25.751913 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5b07670b-6f4f-4e6d-b472-5b510288f8de tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:25.752356 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5b07670b-6f4f-4e6d-b472-5b510288f8de tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:25.752797 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5b07670b-6f4f-4e6d-b472-5b510288f8de tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:25.890294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Flavor limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:06:25.890814 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Image limits 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:06:25.891549 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Flavor pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:06:25.892576 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Image pref 0:0:0 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:06:25.893077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.virt.hardware [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:06:25.899961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5b07670b-6f4f-4e6d-b472-5b510288f8de tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:25.906350 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:25.906962 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:25.907473 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:25.909364 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:25.909364 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:25.909652 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:25.909749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5b07670b-6f4f-4e6d-b472-5b510288f8de tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:25.911562 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5b07670b-6f4f-4e6d-b472-5b510288f8de tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:25.913253 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5b07670b-6f4f-4e6d-b472-5b510288f8de tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1745 microversion: 2.20 time: 0.173721 Aug 24 09:06:25.913806 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 565/1104] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:25 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:06:25.934900 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Getting quotas for project e19c750fc9af412f93ff6369e4c57730. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:06:25.940017 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.quota [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Getting quotas for user faf0d3eebf714e8891c6a3eebf8d87a9 and project e19c750fc9af412f93ff6369e4c57730. Resources: {'ram', 'instances', 'cores'} {{(pid=132985) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:06:25.987101 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-c920bfb9-74c7-43ea-8f15-f5c562608481 req-19e2b2ca-9cc2-4823-940b-d80391e516c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e67a94-aad9-497d-90e2-da6f14343cf8", "tag": "94a39355-84d1-41ed-92b5-bab82d04b265"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:25.997411 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-c920bfb9-74c7-43ea-8f15-f5c562608481 req-19e2b2ca-9cc2-4823-940b-d80391e516c4 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:25.997981 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-c920bfb9-74c7-43ea-8f15-f5c562608481 req-19e2b2ca-9cc2-4823-940b-d80391e516c4 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:25.998491 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-c920bfb9-74c7-43ea-8f15-f5c562608481 req-19e2b2ca-9cc2-4823-940b-d80391e516c4 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:26.011102 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-c920bfb9-74c7-43ea-8f15-f5c562608481 req-19e2b2ca-9cc2-4823-940b-d80391e516c4 service nova] Creating event network-changed:94a39355-84d1-41ed-92b5-bab82d04b265 for instance 84e67a94-aad9-497d-90e2-da6f14343cf8 on hv-cinder-85221 Aug 24 09:06:26.016634 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-c920bfb9-74c7-43ea-8f15-f5c562608481 req-19e2b2ca-9cc2-4823-940b-d80391e516c4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101544 Aug 24 09:06:26.017064 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Going to run 1 instances... {{(pid=132985) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:06:26.017531 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 566/1105] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:26.022638 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20532cd7-3c7f-48d6-85bc-55629bc3df25',volume_size=None,volume_type=None)] {{(pid=132985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:06:26.417936 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ce6a7e5e-617e-44d8-b5d5-ca17def848b2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.584985 Aug 24 09:06:26.418662 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 540/1106] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 09:06:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:06:26.430932 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2804bbcf-bae0-4ff1-9601-6214db3cd556 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:26.431659 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2804bbcf-bae0-4ff1-9601-6214db3cd556 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:26.504188 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2804bbcf-bae0-4ff1-9601-6214db3cd556 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:26.512267 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2804bbcf-bae0-4ff1-9601-6214db3cd556 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1089 microversion: 2.1 time: 0.086214 Aug 24 09:06:26.514053 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 567/1107] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:26 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1089 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:26.937782 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-25aa9c2d-a7a4-4b6c-8dff-3b861d39eece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:26.938489 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-25aa9c2d-a7a4-4b6c-8dff-3b861d39eece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:26.945449 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-25aa9c2d-a7a4-4b6c-8dff-3b861d39eece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:26.945930 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-25aa9c2d-a7a4-4b6c-8dff-3b861d39eece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:26.946368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-25aa9c2d-a7a4-4b6c-8dff-3b861d39eece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:26.947060 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-25aa9c2d-a7a4-4b6c-8dff-3b861d39eece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:26.947514 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-25aa9c2d-a7a4-4b6c-8dff-3b861d39eece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:26.947933 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-25aa9c2d-a7a4-4b6c-8dff-3b861d39eece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:27.090322 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-25aa9c2d-a7a4-4b6c-8dff-3b861d39eece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:27.098607 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-25aa9c2d-a7a4-4b6c-8dff-3b861d39eece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:27.100111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-25aa9c2d-a7a4-4b6c-8dff-3b861d39eece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:27.101857 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-25aa9c2d-a7a4-4b6c-8dff-3b861d39eece tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1745 microversion: 2.20 time: 0.168789 Aug 24 09:06:27.102495 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 541/1108] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:26 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:27.535263 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b16c3d02-eb7c-4e9c-b8b7-69fb7b11b9cc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:27.535811 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b16c3d02-eb7c-4e9c-b8b7-69fb7b11b9cc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:27.590669 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b16c3d02-eb7c-4e9c-b8b7-69fb7b11b9cc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:27.598416 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b16c3d02-eb7c-4e9c-b8b7-69fb7b11b9cc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1089 microversion: 2.1 time: 0.067730 Aug 24 09:06:27.601029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 568/1109] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:27 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:28.128819 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-91f84019-d4e7-493d-b191-4214d9d9fbf3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:28.130047 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-91f84019-d4e7-493d-b191-4214d9d9fbf3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:28.137277 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-91f84019-d4e7-493d-b191-4214d9d9fbf3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:28.137906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-91f84019-d4e7-493d-b191-4214d9d9fbf3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:28.138535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-91f84019-d4e7-493d-b191-4214d9d9fbf3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:28.139440 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-91f84019-d4e7-493d-b191-4214d9d9fbf3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:28.139893 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-91f84019-d4e7-493d-b191-4214d9d9fbf3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:28.140507 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-91f84019-d4e7-493d-b191-4214d9d9fbf3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:28.297889 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-91f84019-d4e7-493d-b191-4214d9d9fbf3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:28.316946 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-91f84019-d4e7-493d-b191-4214d9d9fbf3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:28.319021 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-91f84019-d4e7-493d-b191-4214d9d9fbf3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:28.320904 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-91f84019-d4e7-493d-b191-4214d9d9fbf3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1740 microversion: 2.20 time: 0.198553 Aug 24 09:06:28.321875 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 542/1110] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:28 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:28.619693 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e0964d02-96ee-4c87-92d0-85ceab16e355 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:28.620615 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e0964d02-96ee-4c87-92d0-85ceab16e355 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:28.627857 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e0964d02-96ee-4c87-92d0-85ceab16e355 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:28.628572 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e0964d02-96ee-4c87-92d0-85ceab16e355 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:28.629189 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e0964d02-96ee-4c87-92d0-85ceab16e355 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:28.630384 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e0964d02-96ee-4c87-92d0-85ceab16e355 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:28.631005 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e0964d02-96ee-4c87-92d0-85ceab16e355 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:28.631590 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e0964d02-96ee-4c87-92d0-85ceab16e355 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:28.703792 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e0964d02-96ee-4c87-92d0-85ceab16e355 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:28.719843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e0964d02-96ee-4c87-92d0-85ceab16e355 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1187 microversion: 2.1 time: 0.099957 Aug 24 09:06:28.734262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 569/1111] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:28 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1187 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:29.354603 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-00432621-6160-4e18-babb-478dcdd1228b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:29.356218 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-00432621-6160-4e18-babb-478dcdd1228b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:29.363613 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-00432621-6160-4e18-babb-478dcdd1228b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:29.364206 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-00432621-6160-4e18-babb-478dcdd1228b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:29.364774 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-00432621-6160-4e18-babb-478dcdd1228b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:29.365590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-00432621-6160-4e18-babb-478dcdd1228b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:29.366392 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-00432621-6160-4e18-babb-478dcdd1228b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:29.367015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-00432621-6160-4e18-babb-478dcdd1228b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:29.642292 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-00432621-6160-4e18-babb-478dcdd1228b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:29.651815 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-00432621-6160-4e18-babb-478dcdd1228b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:29.653855 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-00432621-6160-4e18-babb-478dcdd1228b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:29.655336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-00432621-6160-4e18-babb-478dcdd1228b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1740 microversion: 2.20 time: 0.305591 Aug 24 09:06:29.669766 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 543/1112] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:29 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1740 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:29.747638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1ee93d1e-cb39-44fc-ac46-04ef867c5681 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:29.749783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1ee93d1e-cb39-44fc-ac46-04ef867c5681 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:29.764505 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ee93d1e-cb39-44fc-ac46-04ef867c5681 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:29.765414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ee93d1e-cb39-44fc-ac46-04ef867c5681 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:29.767701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ee93d1e-cb39-44fc-ac46-04ef867c5681 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:29.768756 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ee93d1e-cb39-44fc-ac46-04ef867c5681 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:29.769458 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ee93d1e-cb39-44fc-ac46-04ef867c5681 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:29.770103 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ee93d1e-cb39-44fc-ac46-04ef867c5681 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:29.851325 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1ee93d1e-cb39-44fc-ac46-04ef867c5681 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:29.861230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1ee93d1e-cb39-44fc-ac46-04ef867c5681 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1205 microversion: 2.1 time: 0.122839 Aug 24 09:06:29.872951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 570/1113] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:29 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1205 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:30.685634 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e740dd19-9f94-4259-b944-c67903a7d72d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:30.686865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e740dd19-9f94-4259-b944-c67903a7d72d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:30.694047 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e740dd19-9f94-4259-b944-c67903a7d72d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:30.695379 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e740dd19-9f94-4259-b944-c67903a7d72d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:30.695990 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e740dd19-9f94-4259-b944-c67903a7d72d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:30.697015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e740dd19-9f94-4259-b944-c67903a7d72d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:30.700002 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e740dd19-9f94-4259-b944-c67903a7d72d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:30.701388 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e740dd19-9f94-4259-b944-c67903a7d72d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:30.723694 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:30.890555 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2cd10bca-1fa2-4a32-ae57-0fcfeb8fa694 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:30.891213 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2cd10bca-1fa2-4a32-ae57-0fcfeb8fa694 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:30.903865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e740dd19-9f94-4259-b944-c67903a7d72d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:30.910821 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2cd10bca-1fa2-4a32-ae57-0fcfeb8fa694 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:30.911328 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2cd10bca-1fa2-4a32-ae57-0fcfeb8fa694 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:30.911767 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2cd10bca-1fa2-4a32-ae57-0fcfeb8fa694 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:30.912502 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2cd10bca-1fa2-4a32-ae57-0fcfeb8fa694 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:30.913129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2cd10bca-1fa2-4a32-ae57-0fcfeb8fa694 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:30.916731 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2cd10bca-1fa2-4a32-ae57-0fcfeb8fa694 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:30.919844 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e740dd19-9f94-4259-b944-c67903a7d72d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:30.923178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e740dd19-9f94-4259-b944-c67903a7d72d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:30.925499 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e740dd19-9f94-4259-b944-c67903a7d72d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1740 microversion: 2.20 time: 0.245270 Aug 24 09:06:30.926384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 544/1114] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:30 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:31.101078 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2cd10bca-1fa2-4a32-ae57-0fcfeb8fa694 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:31.110115 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2cd10bca-1fa2-4a32-ae57-0fcfeb8fa694 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1272 microversion: 2.1 time: 0.228373 Aug 24 09:06:31.110685 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 571/1115] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:30 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:31.674936 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-203d2665-263f-4c6c-8a05-fa143bfa2d0f req-7f99064f-ecb1-4efd-a2d9-1a15e0505fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d117b5-1850-4c20-9c32-177d76a0f5bb", "tag": "a316d1ef-63e0-44df-bde0-c53760d141f5"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:31.684955 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-203d2665-263f-4c6c-8a05-fa143bfa2d0f req-7f99064f-ecb1-4efd-a2d9-1a15e0505fbd service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:31.686186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-203d2665-263f-4c6c-8a05-fa143bfa2d0f req-7f99064f-ecb1-4efd-a2d9-1a15e0505fbd service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:31.686186 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-203d2665-263f-4c6c-8a05-fa143bfa2d0f req-7f99064f-ecb1-4efd-a2d9-1a15e0505fbd service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:31.697273 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-203d2665-263f-4c6c-8a05-fa143bfa2d0f req-7f99064f-ecb1-4efd-a2d9-1a15e0505fbd service nova] Creating event network-changed:a316d1ef-63e0-44df-bde0-c53760d141f5 for instance 35d117b5-1850-4c20-9c32-177d76a0f5bb on hv-cinder-85221 Aug 24 09:06:31.702384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-203d2665-263f-4c6c-8a05-fa143bfa2d0f req-7f99064f-ecb1-4efd-a2d9-1a15e0505fbd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032097 Aug 24 09:06:31.703669 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 545/1116] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:31.955197 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e29d6ca0-87ed-4cbf-8e97-bed969eb6bc1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:31.955995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e29d6ca0-87ed-4cbf-8e97-bed969eb6bc1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:31.966417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e29d6ca0-87ed-4cbf-8e97-bed969eb6bc1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:31.971046 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e29d6ca0-87ed-4cbf-8e97-bed969eb6bc1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:31.971746 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e29d6ca0-87ed-4cbf-8e97-bed969eb6bc1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:31.972480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e29d6ca0-87ed-4cbf-8e97-bed969eb6bc1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:31.975094 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e29d6ca0-87ed-4cbf-8e97-bed969eb6bc1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:31.975562 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e29d6ca0-87ed-4cbf-8e97-bed969eb6bc1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.135533 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-65ee79a0-a90e-4ff4-b00b-ec09f6013f10 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:32.136236 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-65ee79a0-a90e-4ff4-b00b-ec09f6013f10 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:32.152954 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e29d6ca0-87ed-4cbf-8e97-bed969eb6bc1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:32.157194 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-65ee79a0-a90e-4ff4-b00b-ec09f6013f10 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.163779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-65ee79a0-a90e-4ff4-b00b-ec09f6013f10 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.164512 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-65ee79a0-a90e-4ff4-b00b-ec09f6013f10 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.165451 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-65ee79a0-a90e-4ff4-b00b-ec09f6013f10 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.165593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e29d6ca0-87ed-4cbf-8e97-bed969eb6bc1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:32.166210 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-65ee79a0-a90e-4ff4-b00b-ec09f6013f10 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.166800 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-65ee79a0-a90e-4ff4-b00b-ec09f6013f10 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.167379 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e29d6ca0-87ed-4cbf-8e97-bed969eb6bc1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:32.169007 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e29d6ca0-87ed-4cbf-8e97-bed969eb6bc1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1740 microversion: 2.20 time: 0.217887 Aug 24 09:06:32.169744 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 572/1117] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:31 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:32.425691 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-65ee79a0-a90e-4ff4-b00b-ec09f6013f10 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:32.437519 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-65ee79a0-a90e-4ff4-b00b-ec09f6013f10 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1272 microversion: 2.1 time: 0.309011 Aug 24 09:06:32.452421 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 546/1118] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:32 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1272 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:32.796086 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9e79b874-e8c8-4c28-88e6-008df554f3b2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:32.798442 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9e79b874-e8c8-4c28-88e6-008df554f3b2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:32.805530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e79b874-e8c8-4c28-88e6-008df554f3b2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.806262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e79b874-e8c8-4c28-88e6-008df554f3b2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.806882 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e79b874-e8c8-4c28-88e6-008df554f3b2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.807770 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e79b874-e8c8-4c28-88e6-008df554f3b2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.808218 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e79b874-e8c8-4c28-88e6-008df554f3b2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.808925 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e79b874-e8c8-4c28-88e6-008df554f3b2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.842298 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9e79b874-e8c8-4c28-88e6-008df554f3b2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049996 Aug 24 09:06:32.842876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 573/1119] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:06:32 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:32.857275 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c8e164ef-f535-40c9-91c0-c8d63c711457 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:32.857851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c8e164ef-f535-40c9-91c0-c8d63c711457 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:32.864957 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c8e164ef-f535-40c9-91c0-c8d63c711457 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.865739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c8e164ef-f535-40c9-91c0-c8d63c711457 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.867759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c8e164ef-f535-40c9-91c0-c8d63c711457 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.868682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c8e164ef-f535-40c9-91c0-c8d63c711457 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.869147 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c8e164ef-f535-40c9-91c0-c8d63c711457 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.869595 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c8e164ef-f535-40c9-91c0-c8d63c711457 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.911827 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c8e164ef-f535-40c9-91c0-c8d63c711457 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments/443d072e-27a4-47b3-a35a-7051df48a2f8" status: 200 len: 194 microversion: 2.1 time: 0.059299 Aug 24 09:06:32.919686 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 547/1120] 10.222.0.55 () {58 vars in 1413 bytes} [Wed Aug 24 09:06:32 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments/443d072e-27a4-47b3-a35a-7051df48a2f8 => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:33.194299 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6231ef1c-c07e-4ef9-90d0-171f62a2761a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:33.194998 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6231ef1c-c07e-4ef9-90d0-171f62a2761a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:33.219435 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6231ef1c-c07e-4ef9-90d0-171f62a2761a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:33.221643 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6231ef1c-c07e-4ef9-90d0-171f62a2761a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:33.222423 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6231ef1c-c07e-4ef9-90d0-171f62a2761a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:33.227317 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6231ef1c-c07e-4ef9-90d0-171f62a2761a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:33.227893 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6231ef1c-c07e-4ef9-90d0-171f62a2761a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:33.228579 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6231ef1c-c07e-4ef9-90d0-171f62a2761a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:33.395749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6231ef1c-c07e-4ef9-90d0-171f62a2761a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:33.407862 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6231ef1c-c07e-4ef9-90d0-171f62a2761a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:33.411702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6231ef1c-c07e-4ef9-90d0-171f62a2761a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:33.411702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6231ef1c-c07e-4ef9-90d0-171f62a2761a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1740 microversion: 2.20 time: 0.221230 Aug 24 09:06:33.411932 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 574/1121] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:33 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:33.459522 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3512ce2f-24dd-4d82-ba3d-8d5068738687 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:33.460378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3512ce2f-24dd-4d82-ba3d-8d5068738687 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:33.467749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3512ce2f-24dd-4d82-ba3d-8d5068738687 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:33.469178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3512ce2f-24dd-4d82-ba3d-8d5068738687 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:33.469178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3512ce2f-24dd-4d82-ba3d-8d5068738687 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:33.469523 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3512ce2f-24dd-4d82-ba3d-8d5068738687 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:33.469869 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3512ce2f-24dd-4d82-ba3d-8d5068738687 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:33.470773 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3512ce2f-24dd-4d82-ba3d-8d5068738687 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:33.641415 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3512ce2f-24dd-4d82-ba3d-8d5068738687 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:33.649126 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3512ce2f-24dd-4d82-ba3d-8d5068738687 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1272 microversion: 2.1 time: 0.193939 Aug 24 09:06:33.661420 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 548/1122] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:33 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:34.435925 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4249081c-e7d0-4fb1-a280-7592de7b658b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:34.436450 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4249081c-e7d0-4fb1-a280-7592de7b658b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:34.443650 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4249081c-e7d0-4fb1-a280-7592de7b658b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:34.444222 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4249081c-e7d0-4fb1-a280-7592de7b658b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:34.444829 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4249081c-e7d0-4fb1-a280-7592de7b658b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:34.445603 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4249081c-e7d0-4fb1-a280-7592de7b658b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:34.446127 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4249081c-e7d0-4fb1-a280-7592de7b658b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:34.446623 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4249081c-e7d0-4fb1-a280-7592de7b658b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:34.588836 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4249081c-e7d0-4fb1-a280-7592de7b658b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:34.597145 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4249081c-e7d0-4fb1-a280-7592de7b658b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:34.598671 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4249081c-e7d0-4fb1-a280-7592de7b658b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:34.599833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4249081c-e7d0-4fb1-a280-7592de7b658b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1740 microversion: 2.20 time: 0.168330 Aug 24 09:06:34.601460 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 575/1123] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:34 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:34.671422 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e433e545-5e88-4367-9237-e0a452c1cc4d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:34.672598 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e433e545-5e88-4367-9237-e0a452c1cc4d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:34.679795 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e433e545-5e88-4367-9237-e0a452c1cc4d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:34.680646 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e433e545-5e88-4367-9237-e0a452c1cc4d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:34.680958 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e433e545-5e88-4367-9237-e0a452c1cc4d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:34.692335 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e433e545-5e88-4367-9237-e0a452c1cc4d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:34.692870 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e433e545-5e88-4367-9237-e0a452c1cc4d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:34.693313 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e433e545-5e88-4367-9237-e0a452c1cc4d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:34.847145 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e433e545-5e88-4367-9237-e0a452c1cc4d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:34.857105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e433e545-5e88-4367-9237-e0a452c1cc4d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.189224 Aug 24 09:06:34.858317 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 549/1124] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:34 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:35.623542 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-eddbb1e7-b1dc-48cf-b9c9-7b937b985d03 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:35.625963 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-eddbb1e7-b1dc-48cf-b9c9-7b937b985d03 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:35.630689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eddbb1e7-b1dc-48cf-b9c9-7b937b985d03 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:35.631162 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eddbb1e7-b1dc-48cf-b9c9-7b937b985d03 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:35.631620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eddbb1e7-b1dc-48cf-b9c9-7b937b985d03 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:35.632305 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eddbb1e7-b1dc-48cf-b9c9-7b937b985d03 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:35.632886 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eddbb1e7-b1dc-48cf-b9c9-7b937b985d03 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:35.633201 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eddbb1e7-b1dc-48cf-b9c9-7b937b985d03 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:35.754452 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-04981515-05c5-4b73-ab6a-96cde634a9cf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea40dfa1-7fcb-4f97-9079-39ecf05c6cb2"}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:35.756829 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-04981515-05c5-4b73-ab6a-96cde634a9cf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:35.763688 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04981515-05c5-4b73-ab6a-96cde634a9cf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:35.764187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04981515-05c5-4b73-ab6a-96cde634a9cf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:35.764658 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04981515-05c5-4b73-ab6a-96cde634a9cf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:35.765364 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04981515-05c5-4b73-ab6a-96cde634a9cf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:35.765929 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04981515-05c5-4b73-ab6a-96cde634a9cf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:35.766328 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04981515-05c5-4b73-ab6a-96cde634a9cf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:35.783350 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-eddbb1e7-b1dc-48cf-b9c9-7b937b985d03 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:35.795214 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-eddbb1e7-b1dc-48cf-b9c9-7b937b985d03 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:35.800308 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-eddbb1e7-b1dc-48cf-b9c9-7b937b985d03 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:35.800308 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-eddbb1e7-b1dc-48cf-b9c9-7b937b985d03 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1740 microversion: 2.20 time: 0.179349 Aug 24 09:06:35.800308 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 576/1125] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:35 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:35.879387 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f892d63a-effd-410f-a0da-bfac39380347 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:35.879917 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f892d63a-effd-410f-a0da-bfac39380347 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:35.886672 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f892d63a-effd-410f-a0da-bfac39380347 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:35.887161 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f892d63a-effd-410f-a0da-bfac39380347 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:35.887763 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f892d63a-effd-410f-a0da-bfac39380347 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:35.889029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f892d63a-effd-410f-a0da-bfac39380347 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:35.889692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f892d63a-effd-410f-a0da-bfac39380347 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:35.890327 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f892d63a-effd-410f-a0da-bfac39380347 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:35.923800 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:35.949540 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=6 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:36.050631 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f892d63a-effd-410f-a0da-bfac39380347 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:36.061811 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f892d63a-effd-410f-a0da-bfac39380347 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.187092 Aug 24 09:06:36.062902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 577/1126] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:35 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:36.540368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-04981515-05c5-4b73-ab6a-96cde634a9cf tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "POST /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.789597 Aug 24 09:06:36.541287 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 550/1127] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 09:06:35 2022] POST /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments => generated 194 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:06:36.831926 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2da4f0ab-4256-4036-a672-6f4f47e14e7f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:36.833270 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2da4f0ab-4256-4036-a672-6f4f47e14e7f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:36.841834 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2da4f0ab-4256-4036-a672-6f4f47e14e7f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:36.842614 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2da4f0ab-4256-4036-a672-6f4f47e14e7f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:36.843208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2da4f0ab-4256-4036-a672-6f4f47e14e7f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:36.844091 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2da4f0ab-4256-4036-a672-6f4f47e14e7f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:36.844745 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2da4f0ab-4256-4036-a672-6f4f47e14e7f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:36.845324 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2da4f0ab-4256-4036-a672-6f4f47e14e7f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:37.007952 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2da4f0ab-4256-4036-a672-6f4f47e14e7f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:37.017431 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2da4f0ab-4256-4036-a672-6f4f47e14e7f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:37.022175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2da4f0ab-4256-4036-a672-6f4f47e14e7f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:37.022175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2da4f0ab-4256-4036-a672-6f4f47e14e7f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1740 microversion: 2.20 time: 0.199046 Aug 24 09:06:37.022175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 578/1128] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:36 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:37.086244 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5ebca28f-9aa7-4095-93ae-fe7978f05571 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:37.087557 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5ebca28f-9aa7-4095-93ae-fe7978f05571 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:37.096695 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5ebca28f-9aa7-4095-93ae-fe7978f05571 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:37.097490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5ebca28f-9aa7-4095-93ae-fe7978f05571 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:37.098229 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5ebca28f-9aa7-4095-93ae-fe7978f05571 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:37.100704 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5ebca28f-9aa7-4095-93ae-fe7978f05571 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:37.101469 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5ebca28f-9aa7-4095-93ae-fe7978f05571 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:37.102111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5ebca28f-9aa7-4095-93ae-fe7978f05571 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:37.287456 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5ebca28f-9aa7-4095-93ae-fe7978f05571 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:37.296701 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5ebca28f-9aa7-4095-93ae-fe7978f05571 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.215021 Aug 24 09:06:37.297301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 551/1129] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:37 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:38.045368 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-010a382f-2fd4-4f07-83af-50ffa28e60e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:38.046612 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-010a382f-2fd4-4f07-83af-50ffa28e60e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:38.048851 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=4 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:38.055901 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-010a382f-2fd4-4f07-83af-50ffa28e60e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:38.056386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-010a382f-2fd4-4f07-83af-50ffa28e60e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:38.066906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-010a382f-2fd4-4f07-83af-50ffa28e60e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:38.066906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-010a382f-2fd4-4f07-83af-50ffa28e60e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:38.066906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-010a382f-2fd4-4f07-83af-50ffa28e60e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:38.066906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-010a382f-2fd4-4f07-83af-50ffa28e60e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:38.234210 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-010a382f-2fd4-4f07-83af-50ffa28e60e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:38.259386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-010a382f-2fd4-4f07-83af-50ffa28e60e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:38.262855 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-010a382f-2fd4-4f07-83af-50ffa28e60e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:38.264436 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-010a382f-2fd4-4f07-83af-50ffa28e60e6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1740 microversion: 2.20 time: 0.223469 Aug 24 09:06:38.265351 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 579/1130] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:38 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:38.319621 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ed31e1eb-9289-44a5-ba0f-ea44441b8156 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:38.320819 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ed31e1eb-9289-44a5-ba0f-ea44441b8156 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:38.328676 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed31e1eb-9289-44a5-ba0f-ea44441b8156 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:38.329391 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed31e1eb-9289-44a5-ba0f-ea44441b8156 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:38.330470 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed31e1eb-9289-44a5-ba0f-ea44441b8156 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:38.330993 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed31e1eb-9289-44a5-ba0f-ea44441b8156 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:38.331487 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed31e1eb-9289-44a5-ba0f-ea44441b8156 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:38.331920 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed31e1eb-9289-44a5-ba0f-ea44441b8156 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:38.486340 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ed31e1eb-9289-44a5-ba0f-ea44441b8156 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:38.496103 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ed31e1eb-9289-44a5-ba0f-ea44441b8156 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.181801 Aug 24 09:06:38.496734 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 552/1131] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:38 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:39.289647 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4a490d95-5cbc-4b2b-b05d-f3b6b7541df1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:39.290515 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4a490d95-5cbc-4b2b-b05d-f3b6b7541df1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:39.299930 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a490d95-5cbc-4b2b-b05d-f3b6b7541df1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:39.300675 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a490d95-5cbc-4b2b-b05d-f3b6b7541df1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:39.301116 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a490d95-5cbc-4b2b-b05d-f3b6b7541df1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:39.301821 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a490d95-5cbc-4b2b-b05d-f3b6b7541df1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:39.302272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a490d95-5cbc-4b2b-b05d-f3b6b7541df1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:39.302695 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a490d95-5cbc-4b2b-b05d-f3b6b7541df1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:39.463501 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4a490d95-5cbc-4b2b-b05d-f3b6b7541df1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:39.471959 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4a490d95-5cbc-4b2b-b05d-f3b6b7541df1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:39.477229 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4a490d95-5cbc-4b2b-b05d-f3b6b7541df1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:39.478951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4a490d95-5cbc-4b2b-b05d-f3b6b7541df1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1740 microversion: 2.20 time: 0.193646 Aug 24 09:06:39.479680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 580/1132] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:39 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:39.518270 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0d5445c6-f981-41b4-b6a7-2ef47d8268af tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:39.518917 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0d5445c6-f981-41b4-b6a7-2ef47d8268af tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:39.526331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0d5445c6-f981-41b4-b6a7-2ef47d8268af tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:39.527115 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0d5445c6-f981-41b4-b6a7-2ef47d8268af tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:39.527717 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0d5445c6-f981-41b4-b6a7-2ef47d8268af tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:39.528625 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0d5445c6-f981-41b4-b6a7-2ef47d8268af tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:39.529243 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0d5445c6-f981-41b4-b6a7-2ef47d8268af tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:39.529829 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0d5445c6-f981-41b4-b6a7-2ef47d8268af tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:39.677041 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0d5445c6-f981-41b4-b6a7-2ef47d8268af tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:39.685343 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0d5445c6-f981-41b4-b6a7-2ef47d8268af tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.170900 Aug 24 09:06:39.685939 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 553/1133] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:39 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:40.502475 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e9941cb7-3e88-45aa-939c-6cf8b7f20664 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:40.503104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e9941cb7-3e88-45aa-939c-6cf8b7f20664 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:40.511250 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e9941cb7-3e88-45aa-939c-6cf8b7f20664 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:40.511749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e9941cb7-3e88-45aa-939c-6cf8b7f20664 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:40.512204 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e9941cb7-3e88-45aa-939c-6cf8b7f20664 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:40.512924 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e9941cb7-3e88-45aa-939c-6cf8b7f20664 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:40.513374 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e9941cb7-3e88-45aa-939c-6cf8b7f20664 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:40.513797 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e9941cb7-3e88-45aa-939c-6cf8b7f20664 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:40.645301 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e9941cb7-3e88-45aa-939c-6cf8b7f20664 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:40.653429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e9941cb7-3e88-45aa-939c-6cf8b7f20664 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:40.654916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e9941cb7-3e88-45aa-939c-6cf8b7f20664 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:40.656065 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e9941cb7-3e88-45aa-939c-6cf8b7f20664 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1740 microversion: 2.20 time: 0.157939 Aug 24 09:06:40.656639 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 581/1134] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:40 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:40.706522 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-757a9bda-596f-485d-83a1-b88b2b95e963 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:40.707134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-757a9bda-596f-485d-83a1-b88b2b95e963 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:40.713902 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-757a9bda-596f-485d-83a1-b88b2b95e963 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:40.714406 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-757a9bda-596f-485d-83a1-b88b2b95e963 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:40.714851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-757a9bda-596f-485d-83a1-b88b2b95e963 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:40.715603 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-757a9bda-596f-485d-83a1-b88b2b95e963 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:40.716057 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-757a9bda-596f-485d-83a1-b88b2b95e963 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:40.716484 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-757a9bda-596f-485d-83a1-b88b2b95e963 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:40.847915 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-757a9bda-596f-485d-83a1-b88b2b95e963 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:40.856367 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-757a9bda-596f-485d-83a1-b88b2b95e963 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.153795 Aug 24 09:06:40.857072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 554/1135] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:40 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:41.679108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f581dadd-8ef0-4284-bd75-b101543ab721 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:41.679712 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f581dadd-8ef0-4284-bd75-b101543ab721 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:41.686516 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f581dadd-8ef0-4284-bd75-b101543ab721 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:41.686791 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f581dadd-8ef0-4284-bd75-b101543ab721 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:41.687230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f581dadd-8ef0-4284-bd75-b101543ab721 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:41.688067 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f581dadd-8ef0-4284-bd75-b101543ab721 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:41.688521 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f581dadd-8ef0-4284-bd75-b101543ab721 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:41.689041 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f581dadd-8ef0-4284-bd75-b101543ab721 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:41.819359 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f581dadd-8ef0-4284-bd75-b101543ab721 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:41.828062 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f581dadd-8ef0-4284-bd75-b101543ab721 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:41.829617 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f581dadd-8ef0-4284-bd75-b101543ab721 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:41.830878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f581dadd-8ef0-4284-bd75-b101543ab721 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1740 microversion: 2.20 time: 0.155640 Aug 24 09:06:41.831427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 582/1136] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:41 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:41.877876 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-81a14e7f-1c99-4002-8784-fe29030cf6ea tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:41.878506 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-81a14e7f-1c99-4002-8784-fe29030cf6ea tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:41.885674 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-81a14e7f-1c99-4002-8784-fe29030cf6ea tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:41.886152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-81a14e7f-1c99-4002-8784-fe29030cf6ea tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:41.886578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-81a14e7f-1c99-4002-8784-fe29030cf6ea tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:41.887259 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-81a14e7f-1c99-4002-8784-fe29030cf6ea tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:41.887841 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-81a14e7f-1c99-4002-8784-fe29030cf6ea tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:41.888117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-81a14e7f-1c99-4002-8784-fe29030cf6ea tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:42.028909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-81a14e7f-1c99-4002-8784-fe29030cf6ea tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:42.036966 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-81a14e7f-1c99-4002-8784-fe29030cf6ea tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.163055 Aug 24 09:06:42.037530 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 555/1137] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:41 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:42.854828 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8419a781-65e5-4287-94e9-91396537c2c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:42.855435 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8419a781-65e5-4287-94e9-91396537c2c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:42.862030 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8419a781-65e5-4287-94e9-91396537c2c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:42.862533 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8419a781-65e5-4287-94e9-91396537c2c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:42.862962 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8419a781-65e5-4287-94e9-91396537c2c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:42.863682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8419a781-65e5-4287-94e9-91396537c2c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:42.864144 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8419a781-65e5-4287-94e9-91396537c2c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:42.864585 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8419a781-65e5-4287-94e9-91396537c2c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:43.001556 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8419a781-65e5-4287-94e9-91396537c2c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:43.010047 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8419a781-65e5-4287-94e9-91396537c2c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:43.011551 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8419a781-65e5-4287-94e9-91396537c2c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:43.012726 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8419a781-65e5-4287-94e9-91396537c2c0 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1722 microversion: 2.20 time: 0.161887 Aug 24 09:06:43.013284 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 583/1138] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:42 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:43.057506 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0f60ba30-50fc-4d96-b02c-4892bda40182 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:43.058100 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0f60ba30-50fc-4d96-b02c-4892bda40182 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:43.064624 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f60ba30-50fc-4d96-b02c-4892bda40182 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:43.065095 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f60ba30-50fc-4d96-b02c-4892bda40182 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:43.065520 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f60ba30-50fc-4d96-b02c-4892bda40182 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:43.066203 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f60ba30-50fc-4d96-b02c-4892bda40182 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:43.066643 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f60ba30-50fc-4d96-b02c-4892bda40182 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:43.067049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f60ba30-50fc-4d96-b02c-4892bda40182 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:43.195953 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0f60ba30-50fc-4d96-b02c-4892bda40182 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:43.203881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0f60ba30-50fc-4d96-b02c-4892bda40182 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.150880 Aug 24 09:06:43.204448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 556/1139] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:43 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:44.035345 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-6ee1f94a-74be-4c98-8b62-6bc1fbb605b1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:44.035949 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-6ee1f94a-74be-4c98-8b62-6bc1fbb605b1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:44.042613 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6ee1f94a-74be-4c98-8b62-6bc1fbb605b1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:44.043098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6ee1f94a-74be-4c98-8b62-6bc1fbb605b1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:44.043529 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6ee1f94a-74be-4c98-8b62-6bc1fbb605b1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:44.044212 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6ee1f94a-74be-4c98-8b62-6bc1fbb605b1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:44.044694 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6ee1f94a-74be-4c98-8b62-6bc1fbb605b1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:44.045112 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-6ee1f94a-74be-4c98-8b62-6bc1fbb605b1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:44.050182 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:44.180426 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6ee1f94a-74be-4c98-8b62-6bc1fbb605b1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:44.189104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6ee1f94a-74be-4c98-8b62-6bc1fbb605b1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:44.190570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-6ee1f94a-74be-4c98-8b62-6bc1fbb605b1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:44.191702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-6ee1f94a-74be-4c98-8b62-6bc1fbb605b1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1722 microversion: 2.20 time: 0.160446 Aug 24 09:06:44.192737 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 584/1140] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:44 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:44.224316 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fa1e1eba-d4de-4826-bfb8-1e8ea065207e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:44.224947 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-fa1e1eba-d4de-4826-bfb8-1e8ea065207e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:44.231322 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa1e1eba-d4de-4826-bfb8-1e8ea065207e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:44.231794 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa1e1eba-d4de-4826-bfb8-1e8ea065207e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:44.232221 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa1e1eba-d4de-4826-bfb8-1e8ea065207e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:44.232937 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa1e1eba-d4de-4826-bfb8-1e8ea065207e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:44.233375 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa1e1eba-d4de-4826-bfb8-1e8ea065207e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:44.233786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fa1e1eba-d4de-4826-bfb8-1e8ea065207e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:44.366655 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fa1e1eba-d4de-4826-bfb8-1e8ea065207e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:44.374901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fa1e1eba-d4de-4826-bfb8-1e8ea065207e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.154425 Aug 24 09:06:44.375454 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 557/1141] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:44 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:45.216524 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5d6f42dd-7306-4e50-8ae6-d318c75f0d2e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:45.217255 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5d6f42dd-7306-4e50-8ae6-d318c75f0d2e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:45.223564 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5d6f42dd-7306-4e50-8ae6-d318c75f0d2e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:45.224046 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5d6f42dd-7306-4e50-8ae6-d318c75f0d2e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:45.224479 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5d6f42dd-7306-4e50-8ae6-d318c75f0d2e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:45.225189 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5d6f42dd-7306-4e50-8ae6-d318c75f0d2e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:45.225631 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5d6f42dd-7306-4e50-8ae6-d318c75f0d2e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:45.226255 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5d6f42dd-7306-4e50-8ae6-d318c75f0d2e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:45.360622 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5d6f42dd-7306-4e50-8ae6-d318c75f0d2e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:45.369653 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5d6f42dd-7306-4e50-8ae6-d318c75f0d2e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:45.371150 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5d6f42dd-7306-4e50-8ae6-d318c75f0d2e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:45.372296 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5d6f42dd-7306-4e50-8ae6-d318c75f0d2e tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1722 microversion: 2.20 time: 0.160810 Aug 24 09:06:45.372892 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 585/1142] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:45 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:45.395263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9c84700e-ecba-4e80-8f32-84833c7c63c2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:45.395894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9c84700e-ecba-4e80-8f32-84833c7c63c2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:45.403176 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9c84700e-ecba-4e80-8f32-84833c7c63c2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:45.403651 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9c84700e-ecba-4e80-8f32-84833c7c63c2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:45.404102 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9c84700e-ecba-4e80-8f32-84833c7c63c2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:45.404831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9c84700e-ecba-4e80-8f32-84833c7c63c2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:45.405274 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9c84700e-ecba-4e80-8f32-84833c7c63c2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:45.405687 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9c84700e-ecba-4e80-8f32-84833c7c63c2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:45.541197 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9c84700e-ecba-4e80-8f32-84833c7c63c2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:45.548997 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9c84700e-ecba-4e80-8f32-84833c7c63c2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.157508 Aug 24 09:06:45.549558 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 558/1143] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:45 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:46.059344 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-89bd3060-f2f3-4f0a-a85e-e2368b8f7346 req-9ab777fc-8ac9-45ae-92bc-abc092b79f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d117b5-1850-4c20-9c32-177d76a0f5bb", "name": "network-vif-plugged", "status": "completed", "tag": "a316d1ef-63e0-44df-bde0-c53760d141f5"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:46.068949 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-89bd3060-f2f3-4f0a-a85e-e2368b8f7346 req-9ab777fc-8ac9-45ae-92bc-abc092b79f14 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:46.069425 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-89bd3060-f2f3-4f0a-a85e-e2368b8f7346 req-9ab777fc-8ac9-45ae-92bc-abc092b79f14 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:46.069856 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-89bd3060-f2f3-4f0a-a85e-e2368b8f7346 req-9ab777fc-8ac9-45ae-92bc-abc092b79f14 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:46.080866 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-89bd3060-f2f3-4f0a-a85e-e2368b8f7346 req-9ab777fc-8ac9-45ae-92bc-abc092b79f14 service nova] Creating event network-vif-plugged:a316d1ef-63e0-44df-bde0-c53760d141f5 for instance 35d117b5-1850-4c20-9c32-177d76a0f5bb on hv-cinder-85221 Aug 24 09:06:46.085716 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-89bd3060-f2f3-4f0a-a85e-e2368b8f7346 req-9ab777fc-8ac9-45ae-92bc-abc092b79f14 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031541 Aug 24 09:06:46.086300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 586/1144] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:46.257681 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-154f3130-7073-4efe-a55e-9dfe8835141b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:46.262629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-154f3130-7073-4efe-a55e-9dfe8835141b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:46.268088 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-154f3130-7073-4efe-a55e-9dfe8835141b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:46.268594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-154f3130-7073-4efe-a55e-9dfe8835141b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:46.269031 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-154f3130-7073-4efe-a55e-9dfe8835141b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:46.269777 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-154f3130-7073-4efe-a55e-9dfe8835141b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:46.270704 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-154f3130-7073-4efe-a55e-9dfe8835141b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:46.271209 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-154f3130-7073-4efe-a55e-9dfe8835141b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:46.309469 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-154f3130-7073-4efe-a55e-9dfe8835141b tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058687 Aug 24 09:06:46.310513 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 559/1145] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:06:46 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:46.398224 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-44699b5d-82a7-4c85-94ac-b3eb121685b4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:46.398914 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-44699b5d-82a7-4c85-94ac-b3eb121685b4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:46.405781 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-44699b5d-82a7-4c85-94ac-b3eb121685b4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:46.406252 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-44699b5d-82a7-4c85-94ac-b3eb121685b4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:46.406769 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-44699b5d-82a7-4c85-94ac-b3eb121685b4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:46.407414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-44699b5d-82a7-4c85-94ac-b3eb121685b4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:46.407858 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-44699b5d-82a7-4c85-94ac-b3eb121685b4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:46.408278 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-44699b5d-82a7-4c85-94ac-b3eb121685b4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:46.460840 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8bc6cfd9-396e-4cef-99e9-8612aae62de3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:46.461507 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8bc6cfd9-396e-4cef-99e9-8612aae62de3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:46.469860 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8bc6cfd9-396e-4cef-99e9-8612aae62de3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:46.470467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8bc6cfd9-396e-4cef-99e9-8612aae62de3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:46.471031 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8bc6cfd9-396e-4cef-99e9-8612aae62de3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:46.471872 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8bc6cfd9-396e-4cef-99e9-8612aae62de3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:46.473115 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8bc6cfd9-396e-4cef-99e9-8612aae62de3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:46.473692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8bc6cfd9-396e-4cef-99e9-8612aae62de3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:46.496071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:46.511141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8bc6cfd9-396e-4cef-99e9-8612aae62de3 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments/443d072e-27a4-47b3-a35a-7051df48a2f8" status: 200 len: 194 microversion: 2.1 time: 0.054704 Aug 24 09:06:46.512078 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 560/1146] 10.222.0.55 () {58 vars in 1413 bytes} [Wed Aug 24 09:06:46 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments/443d072e-27a4-47b3-a35a-7051df48a2f8 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:06:46.523239 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1334aaf5-8a19-4dda-9da3-9627a6ccf86f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:46.524266 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1334aaf5-8a19-4dda-9da3-9627a6ccf86f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:46.531565 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1334aaf5-8a19-4dda-9da3-9627a6ccf86f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:46.532420 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1334aaf5-8a19-4dda-9da3-9627a6ccf86f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:46.533092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1334aaf5-8a19-4dda-9da3-9627a6ccf86f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:46.534439 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1334aaf5-8a19-4dda-9da3-9627a6ccf86f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:46.535107 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1334aaf5-8a19-4dda-9da3-9627a6ccf86f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:46.535610 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1334aaf5-8a19-4dda-9da3-9627a6ccf86f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:46.636840 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-1334aaf5-8a19-4dda-9da3-9627a6ccf86f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lazy-loading 'services' on Instance uuid db3a6687-812a-4169-96f5-0e7e9f3af30f {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:06:46.659249 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-44699b5d-82a7-4c85-94ac-b3eb121685b4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:46.669201 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-44699b5d-82a7-4c85-94ac-b3eb121685b4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:46.671006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-44699b5d-82a7-4c85-94ac-b3eb121685b4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:46.672237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-44699b5d-82a7-4c85-94ac-b3eb121685b4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1722 microversion: 2.20 time: 0.278878 Aug 24 09:06:46.673116 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 587/1147] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:46 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:06:46.684882 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4bad0442-c08f-4f89-ad9f-3e1f11b59f33 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:46.685621 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4bad0442-c08f-4f89-ad9f-3e1f11b59f33 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:46.691759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4bad0442-c08f-4f89-ad9f-3e1f11b59f33 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:46.692271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4bad0442-c08f-4f89-ad9f-3e1f11b59f33 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:46.692730 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4bad0442-c08f-4f89-ad9f-3e1f11b59f33 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:46.693456 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4bad0442-c08f-4f89-ad9f-3e1f11b59f33 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:46.693959 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4bad0442-c08f-4f89-ad9f-3e1f11b59f33 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:46.694377 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4bad0442-c08f-4f89-ad9f-3e1f11b59f33 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:46.808844 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1334aaf5-8a19-4dda-9da3-9627a6ccf86f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "DELETE /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments/443d072e-27a4-47b3-a35a-7051df48a2f8" status: 202 len: 0 microversion: 2.1 time: 0.289871 Aug 24 09:06:46.809463 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 561/1148] 10.222.0.55 () {58 vars in 1416 bytes} [Wed Aug 24 09:06:46 2022] DELETE /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments/443d072e-27a4-47b3-a35a-7051df48a2f8 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:06:46.828220 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4bad0442-c08f-4f89-ad9f-3e1f11b59f33 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:46.836045 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4bad0442-c08f-4f89-ad9f-3e1f11b59f33 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.161557 Aug 24 09:06:46.836631 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 588/1149] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:46 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:47.696528 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0f06e68e-dc93-4d32-9743-370560ffb02b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:47.697254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0f06e68e-dc93-4d32-9743-370560ffb02b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:47.703471 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f06e68e-dc93-4d32-9743-370560ffb02b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:47.703976 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f06e68e-dc93-4d32-9743-370560ffb02b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:47.704408 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f06e68e-dc93-4d32-9743-370560ffb02b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:47.705125 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f06e68e-dc93-4d32-9743-370560ffb02b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:47.705576 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f06e68e-dc93-4d32-9743-370560ffb02b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:47.705997 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0f06e68e-dc93-4d32-9743-370560ffb02b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:47.833897 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0f06e68e-dc93-4d32-9743-370560ffb02b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:47.842550 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0f06e68e-dc93-4d32-9743-370560ffb02b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:47.844051 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0f06e68e-dc93-4d32-9743-370560ffb02b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:47.845230 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0f06e68e-dc93-4d32-9743-370560ffb02b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1665 microversion: 2.20 time: 0.153502 Aug 24 09:06:47.845792 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 562/1150] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:47 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:47.859807 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-98f3d95e-309c-4c6f-b120-894be6270c9b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:47.864814 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-98f3d95e-309c-4c6f-b120-894be6270c9b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:47.867325 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-98f3d95e-309c-4c6f-b120-894be6270c9b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:47.867802 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-98f3d95e-309c-4c6f-b120-894be6270c9b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:47.868226 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-98f3d95e-309c-4c6f-b120-894be6270c9b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:47.868939 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-98f3d95e-309c-4c6f-b120-894be6270c9b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:47.869427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-98f3d95e-309c-4c6f-b120-894be6270c9b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:47.870471 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-98f3d95e-309c-4c6f-b120-894be6270c9b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:47.871785 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2809bfe1-80fc-4386-af4a-d7c841c35972 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "787f164c-ebb5-41e8-b15d-5d39d2c924a2"}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:47.875786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2809bfe1-80fc-4386-af4a-d7c841c35972 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:47.880324 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2809bfe1-80fc-4386-af4a-d7c841c35972 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:47.880837 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2809bfe1-80fc-4386-af4a-d7c841c35972 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:47.881273 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2809bfe1-80fc-4386-af4a-d7c841c35972 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:47.881975 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2809bfe1-80fc-4386-af4a-d7c841c35972 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:47.882567 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2809bfe1-80fc-4386-af4a-d7c841c35972 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:47.882995 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2809bfe1-80fc-4386-af4a-d7c841c35972 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:48.013825 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-98f3d95e-309c-4c6f-b120-894be6270c9b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:48.033662 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-98f3d95e-309c-4c6f-b120-894be6270c9b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.177809 Aug 24 09:06:48.034935 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 589/1151] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:47 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:48.099571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-63e7a1f3-3734-413b-8bd4-27352f08b6fd req-ff78e5f7-e0a6-4fc3-ab89-b93e57a93877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fe50f9-e517-4e9a-80b5-6faba0b9f10a", "name": "network-vif-unplugged", "status": "completed", "tag": "8d40ee89-fb81-4d38-99c2-3dac67fab1b0"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:48.109509 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-63e7a1f3-3734-413b-8bd4-27352f08b6fd req-ff78e5f7-e0a6-4fc3-ab89-b93e57a93877 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:48.109936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-63e7a1f3-3734-413b-8bd4-27352f08b6fd req-ff78e5f7-e0a6-4fc3-ab89-b93e57a93877 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:48.110359 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-63e7a1f3-3734-413b-8bd4-27352f08b6fd req-ff78e5f7-e0a6-4fc3-ab89-b93e57a93877 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:48.128993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.compute.server_external_events [req-63e7a1f3-3734-413b-8bd4-27352f08b6fd req-ff78e5f7-e0a6-4fc3-ab89-b93e57a93877 service nova] Unable to find a host for instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a. Dropping event network-vif-unplugged {{(pid=132984) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 09:06:48.128993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-63e7a1f3-3734-413b-8bd4-27352f08b6fd req-ff78e5f7-e0a6-4fc3-ab89-b93e57a93877 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028548 Aug 24 09:06:48.128993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 590/1152] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 09:06:48.854206 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2809bfe1-80fc-4386-af4a-d7c841c35972 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "POST /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.986465 Aug 24 09:06:48.854968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 563/1153] 10.222.0.55 () {62 vars in 1364 bytes} [Wed Aug 24 09:06:47 2022] POST /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/os-volume_attachments => generated 188 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 09:06:48.979287 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-bdd9e5a1-a306-428c-b522-aa4ecfcba136 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:48.979767 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-bdd9e5a1-a306-428c-b522-aa4ecfcba136 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:48.986787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bdd9e5a1-a306-428c-b522-aa4ecfcba136 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:48.987275 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bdd9e5a1-a306-428c-b522-aa4ecfcba136 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:48.987707 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bdd9e5a1-a306-428c-b522-aa4ecfcba136 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:48.988400 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bdd9e5a1-a306-428c-b522-aa4ecfcba136 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:48.988880 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bdd9e5a1-a306-428c-b522-aa4ecfcba136 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:48.989299 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bdd9e5a1-a306-428c-b522-aa4ecfcba136 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:49.055216 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9bc6c63b-4846-423e-b193-0416fa263e52 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:49.055811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9bc6c63b-4846-423e-b193-0416fa263e52 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:49.062566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9bc6c63b-4846-423e-b193-0416fa263e52 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:49.063180 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9bc6c63b-4846-423e-b193-0416fa263e52 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:49.063563 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9bc6c63b-4846-423e-b193-0416fa263e52 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:49.064254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9bc6c63b-4846-423e-b193-0416fa263e52 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:49.064801 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9bc6c63b-4846-423e-b193-0416fa263e52 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:49.065217 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9bc6c63b-4846-423e-b193-0416fa263e52 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:49.201764 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9bc6c63b-4846-423e-b193-0416fa263e52 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:49.209780 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9bc6c63b-4846-423e-b193-0416fa263e52 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1444 microversion: 2.1 time: 0.158417 Aug 24 09:06:49.210345 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 564/1154] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:49 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:49.230331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ae15b6e6-b868-40ad-8f4a-91df612bed9f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:49.230931 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ae15b6e6-b868-40ad-8f4a-91df612bed9f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:49.236862 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae15b6e6-b868-40ad-8f4a-91df612bed9f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:49.237418 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae15b6e6-b868-40ad-8f4a-91df612bed9f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:49.237845 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae15b6e6-b868-40ad-8f4a-91df612bed9f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:49.238631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae15b6e6-b868-40ad-8f4a-91df612bed9f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:49.239100 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae15b6e6-b868-40ad-8f4a-91df612bed9f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:49.239521 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ae15b6e6-b868-40ad-8f4a-91df612bed9f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:49.371215 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ae15b6e6-b868-40ad-8f4a-91df612bed9f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:49.378953 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ae15b6e6-b868-40ad-8f4a-91df612bed9f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1444 microversion: 2.1 time: 0.152686 Aug 24 09:06:49.379529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 565/1155] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:49 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:49.597062 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-bdd9e5a1-a306-428c-b522-aa4ecfcba136 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "DELETE /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/os-volume_attachments/787f164c-ebb5-41e8-b15d-5d39d2c924a2" status: 202 len: 0 microversion: 2.20 time: 0.622246 Aug 24 09:06:49.597753 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 591/1156] 10.222.0.55 () {60 vars in 1457 bytes} [Wed Aug 24 09:06:48 2022] DELETE /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/os-volume_attachments/787f164c-ebb5-41e8-b15d-5d39d2c924a2 => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:06:49.664335 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d73fa394-7373-44d6-9695-f55d2e787b26 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:49.665124 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d73fa394-7373-44d6-9695-f55d2e787b26 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:49.671899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d73fa394-7373-44d6-9695-f55d2e787b26 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:49.672394 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d73fa394-7373-44d6-9695-f55d2e787b26 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:49.672885 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d73fa394-7373-44d6-9695-f55d2e787b26 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:49.673594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d73fa394-7373-44d6-9695-f55d2e787b26 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:49.674044 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d73fa394-7373-44d6-9695-f55d2e787b26 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:49.674467 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d73fa394-7373-44d6-9695-f55d2e787b26 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:49.719437 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d73fa394-7373-44d6-9695-f55d2e787b26 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132985) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 09:06:50.022729 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d73fa394-7373-44d6-9695-f55d2e787b26 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "POST /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/action" status: 202 len: 0 microversion: 2.20 time: 0.362295 Aug 24 09:06:50.024309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 566/1157] 10.222.0.55 () {62 vars in 1319 bytes} [Wed Aug 24 09:06:49 2022] POST /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:06:50.033110 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b6ed6c1c-9652-43b8-93e3-4ab7e96c7006 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:50.033693 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b6ed6c1c-9652-43b8-93e3-4ab7e96c7006 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:50.043128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b6ed6c1c-9652-43b8-93e3-4ab7e96c7006 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:50.045102 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b6ed6c1c-9652-43b8-93e3-4ab7e96c7006 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:50.045551 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b6ed6c1c-9652-43b8-93e3-4ab7e96c7006 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:50.046281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b6ed6c1c-9652-43b8-93e3-4ab7e96c7006 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:50.046770 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b6ed6c1c-9652-43b8-93e3-4ab7e96c7006 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:50.047193 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b6ed6c1c-9652-43b8-93e3-4ab7e96c7006 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:50.077447 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f19f011f-4f68-4a0b-b848-a9661d3e8524 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:50.078138 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f19f011f-4f68-4a0b-b848-a9661d3e8524 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:50.084747 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f19f011f-4f68-4a0b-b848-a9661d3e8524 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:50.085323 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f19f011f-4f68-4a0b-b848-a9661d3e8524 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:50.085831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f19f011f-4f68-4a0b-b848-a9661d3e8524 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:50.086750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f19f011f-4f68-4a0b-b848-a9661d3e8524 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:50.087277 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f19f011f-4f68-4a0b-b848-a9661d3e8524 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:50.087803 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f19f011f-4f68-4a0b-b848-a9661d3e8524 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:50.120076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f19f011f-4f68-4a0b-b848-a9661d3e8524 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments/ea40dfa1-7fcb-4f97-9079-39ecf05c6cb2" status: 200 len: 194 microversion: 2.1 time: 0.046649 Aug 24 09:06:50.121411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 567/1158] 10.222.0.55 () {58 vars in 1413 bytes} [Wed Aug 24 09:06:50 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments/ea40dfa1-7fcb-4f97-9079-39ecf05c6cb2 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:50.132310 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6adb9cdc-0009-42e9-9bc8-cf034fcb0bab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:50.133001 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6adb9cdc-0009-42e9-9bc8-cf034fcb0bab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:50.141772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6adb9cdc-0009-42e9-9bc8-cf034fcb0bab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:50.142955 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6adb9cdc-0009-42e9-9bc8-cf034fcb0bab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:50.143407 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6adb9cdc-0009-42e9-9bc8-cf034fcb0bab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:50.144270 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6adb9cdc-0009-42e9-9bc8-cf034fcb0bab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:50.144800 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6adb9cdc-0009-42e9-9bc8-cf034fcb0bab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:50.145173 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6adb9cdc-0009-42e9-9bc8-cf034fcb0bab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:50.242093 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-6adb9cdc-0009-42e9-9bc8-cf034fcb0bab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lazy-loading 'services' on Instance uuid db3a6687-812a-4169-96f5-0e7e9f3af30f {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:06:50.254441 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b6ed6c1c-9652-43b8-93e3-4ab7e96c7006 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:50.266602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b6ed6c1c-9652-43b8-93e3-4ab7e96c7006 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:50.268345 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b6ed6c1c-9652-43b8-93e3-4ab7e96c7006 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:50.269714 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b6ed6c1c-9652-43b8-93e3-4ab7e96c7006 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1673 microversion: 2.20 time: 0.240671 Aug 24 09:06:50.270271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 592/1159] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:50 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1673 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:50.535016 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6adb9cdc-0009-42e9-9bc8-cf034fcb0bab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "DELETE /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments/ea40dfa1-7fcb-4f97-9079-39ecf05c6cb2" status: 202 len: 0 microversion: 2.1 time: 0.407594 Aug 24 09:06:50.539008 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 568/1160] 10.222.0.55 () {58 vars in 1416 bytes} [Wed Aug 24 09:06:50 2022] DELETE /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments/ea40dfa1-7fcb-4f97-9079-39ecf05c6cb2 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:06:51.297868 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1ca73b21-81cf-4c0f-93e2-cad4e7d40cf1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:51.297868 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1ca73b21-81cf-4c0f-93e2-cad4e7d40cf1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:51.302495 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ca73b21-81cf-4c0f-93e2-cad4e7d40cf1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:51.302976 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ca73b21-81cf-4c0f-93e2-cad4e7d40cf1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:51.303408 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ca73b21-81cf-4c0f-93e2-cad4e7d40cf1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:51.304154 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ca73b21-81cf-4c0f-93e2-cad4e7d40cf1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:51.304659 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ca73b21-81cf-4c0f-93e2-cad4e7d40cf1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:51.305080 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1ca73b21-81cf-4c0f-93e2-cad4e7d40cf1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:51.536747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1ca73b21-81cf-4c0f-93e2-cad4e7d40cf1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:51.545826 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1ca73b21-81cf-4c0f-93e2-cad4e7d40cf1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:51.547345 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1ca73b21-81cf-4c0f-93e2-cad4e7d40cf1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:51.548494 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1ca73b21-81cf-4c0f-93e2-cad4e7d40cf1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1673 microversion: 2.20 time: 0.258599 Aug 24 09:06:51.549177 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 593/1161] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:51 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1673 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:51.985272 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-33d188b6-9d87-4166-bd1b-4990944676fa req-84fa8845-e920-4fe0-a888-0a4ef20b848a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d117b5-1850-4c20-9c32-177d76a0f5bb", "tag": "a316d1ef-63e0-44df-bde0-c53760d141f5"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:51.996767 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-33d188b6-9d87-4166-bd1b-4990944676fa req-84fa8845-e920-4fe0-a888-0a4ef20b848a service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:51.997345 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-33d188b6-9d87-4166-bd1b-4990944676fa req-84fa8845-e920-4fe0-a888-0a4ef20b848a service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:51.997836 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-33d188b6-9d87-4166-bd1b-4990944676fa req-84fa8845-e920-4fe0-a888-0a4ef20b848a service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:52.009241 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-33d188b6-9d87-4166-bd1b-4990944676fa req-84fa8845-e920-4fe0-a888-0a4ef20b848a service nova] Creating event network-changed:a316d1ef-63e0-44df-bde0-c53760d141f5 for instance 35d117b5-1850-4c20-9c32-177d76a0f5bb on hv-cinder-85221 Aug 24 09:06:52.014881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-33d188b6-9d87-4166-bd1b-4990944676fa req-84fa8845-e920-4fe0-a888-0a4ef20b848a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097268 Aug 24 09:06:52.015564 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 569/1162] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:52.571579 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8d73543f-e21d-419b-8063-237d9f182d72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:52.572810 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8d73543f-e21d-419b-8063-237d9f182d72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:52.574850 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=74 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:52.579966 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8d73543f-e21d-419b-8063-237d9f182d72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:52.580453 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8d73543f-e21d-419b-8063-237d9f182d72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:52.581409 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8d73543f-e21d-419b-8063-237d9f182d72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:52.581665 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8d73543f-e21d-419b-8063-237d9f182d72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:52.582060 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8d73543f-e21d-419b-8063-237d9f182d72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:52.582781 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8d73543f-e21d-419b-8063-237d9f182d72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:52.721634 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8d73543f-e21d-419b-8063-237d9f182d72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:52.735364 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8d73543f-e21d-419b-8063-237d9f182d72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:52.736819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-8d73543f-e21d-419b-8063-237d9f182d72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:52.737965 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8d73543f-e21d-419b-8063-237d9f182d72 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1675 microversion: 2.20 time: 0.170511 Aug 24 09:06:52.738524 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 594/1163] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:52 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:53.762764 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7ecbb229-436e-4c9f-95ab-973cd52921a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:53.763460 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-7ecbb229-436e-4c9f-95ab-973cd52921a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:53.765421 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:53.770265 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7ecbb229-436e-4c9f-95ab-973cd52921a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:53.770743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7ecbb229-436e-4c9f-95ab-973cd52921a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:53.771174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7ecbb229-436e-4c9f-95ab-973cd52921a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:53.771869 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7ecbb229-436e-4c9f-95ab-973cd52921a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:53.781278 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7ecbb229-436e-4c9f-95ab-973cd52921a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:53.781278 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7ecbb229-436e-4c9f-95ab-973cd52921a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:53.910817 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7ecbb229-436e-4c9f-95ab-973cd52921a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:53.920223 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7ecbb229-436e-4c9f-95ab-973cd52921a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:53.921784 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7ecbb229-436e-4c9f-95ab-973cd52921a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:53.922953 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7ecbb229-436e-4c9f-95ab-973cd52921a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1675 microversion: 2.20 time: 0.165561 Aug 24 09:06:53.923503 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 570/1164] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:53 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:54.946374 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-20ff90c1-20cf-473e-a9ba-f64772c858c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:54.947021 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-20ff90c1-20cf-473e-a9ba-f64772c858c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:54.954183 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-20ff90c1-20cf-473e-a9ba-f64772c858c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:54.954662 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-20ff90c1-20cf-473e-a9ba-f64772c858c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:54.955098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-20ff90c1-20cf-473e-a9ba-f64772c858c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:54.955781 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-20ff90c1-20cf-473e-a9ba-f64772c858c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:54.956263 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-20ff90c1-20cf-473e-a9ba-f64772c858c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:54.956736 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-20ff90c1-20cf-473e-a9ba-f64772c858c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:55.085638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-20ff90c1-20cf-473e-a9ba-f64772c858c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:55.093668 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-20ff90c1-20cf-473e-a9ba-f64772c858c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:55.095162 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-20ff90c1-20cf-473e-a9ba-f64772c858c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:55.096300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-20ff90c1-20cf-473e-a9ba-f64772c858c7 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1675 microversion: 2.20 time: 0.153810 Aug 24 09:06:55.096885 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 595/1165] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:54 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:56.118872 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3f1e127d-b3a2-4903-94a5-38bbdd4dd7f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:56.119417 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3f1e127d-b3a2-4903-94a5-38bbdd4dd7f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:56.127119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3f1e127d-b3a2-4903-94a5-38bbdd4dd7f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:56.127323 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3f1e127d-b3a2-4903-94a5-38bbdd4dd7f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:56.127740 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3f1e127d-b3a2-4903-94a5-38bbdd4dd7f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:56.128435 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3f1e127d-b3a2-4903-94a5-38bbdd4dd7f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:56.128898 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3f1e127d-b3a2-4903-94a5-38bbdd4dd7f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:56.129316 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3f1e127d-b3a2-4903-94a5-38bbdd4dd7f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:56.266682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3f1e127d-b3a2-4903-94a5-38bbdd4dd7f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:56.275284 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3f1e127d-b3a2-4903-94a5-38bbdd4dd7f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:56.276826 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3f1e127d-b3a2-4903-94a5-38bbdd4dd7f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:56.278633 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3f1e127d-b3a2-4903-94a5-38bbdd4dd7f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.163583 Aug 24 09:06:56.279179 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 571/1166] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:56 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:57.022738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2be9b0a1-c162-47e3-81a5-3b8d9da0d203 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:57.022738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2be9b0a1-c162-47e3-81a5-3b8d9da0d203 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:57.024113 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2be9b0a1-c162-47e3-81a5-3b8d9da0d203 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:57.024644 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2be9b0a1-c162-47e3-81a5-3b8d9da0d203 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:57.025079 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2be9b0a1-c162-47e3-81a5-3b8d9da0d203 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:57.026105 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2be9b0a1-c162-47e3-81a5-3b8d9da0d203 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:57.026441 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2be9b0a1-c162-47e3-81a5-3b8d9da0d203 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:57.026862 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2be9b0a1-c162-47e3-81a5-3b8d9da0d203 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:57.063115 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2be9b0a1-c162-47e3-81a5-3b8d9da0d203 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052546 Aug 24 09:06:57.066709 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 596/1167] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:06:57 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:06:57.178922 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2dae58ee-fca4-44d0-b4e7-e5085cd1a1b8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:57.181201 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2dae58ee-fca4-44d0-b4e7-e5085cd1a1b8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:57.188529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2dae58ee-fca4-44d0-b4e7-e5085cd1a1b8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:57.189156 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2dae58ee-fca4-44d0-b4e7-e5085cd1a1b8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:57.189585 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2dae58ee-fca4-44d0-b4e7-e5085cd1a1b8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:57.190276 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2dae58ee-fca4-44d0-b4e7-e5085cd1a1b8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:57.190720 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2dae58ee-fca4-44d0-b4e7-e5085cd1a1b8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:57.191142 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2dae58ee-fca4-44d0-b4e7-e5085cd1a1b8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:57.225488 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=6,nova_cell1:UPDATE=5 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:57.225488 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2dae58ee-fca4-44d0-b4e7-e5085cd1a1b8 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047074 Aug 24 09:06:57.225488 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 572/1168] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:06:57 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:06:57.284817 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0963ab04-637a-4915-b9ee-64c6140ad5ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:57.285387 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0963ab04-637a-4915-b9ee-64c6140ad5ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:57.292133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0963ab04-637a-4915-b9ee-64c6140ad5ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:57.292761 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0963ab04-637a-4915-b9ee-64c6140ad5ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:57.293280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0963ab04-637a-4915-b9ee-64c6140ad5ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:57.294774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0963ab04-637a-4915-b9ee-64c6140ad5ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:57.295309 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0963ab04-637a-4915-b9ee-64c6140ad5ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:57.295863 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0963ab04-637a-4915-b9ee-64c6140ad5ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:57.305260 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-bd3f1960-683d-42c1-aec0-25bc8f987948 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:57.306067 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-bd3f1960-683d-42c1-aec0-25bc8f987948 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:57.312910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bd3f1960-683d-42c1-aec0-25bc8f987948 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:57.314307 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bd3f1960-683d-42c1-aec0-25bc8f987948 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:57.315160 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bd3f1960-683d-42c1-aec0-25bc8f987948 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:57.316160 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bd3f1960-683d-42c1-aec0-25bc8f987948 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:57.316865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bd3f1960-683d-42c1-aec0-25bc8f987948 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:57.317451 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-bd3f1960-683d-42c1-aec0-25bc8f987948 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:57.327649 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0963ab04-637a-4915-b9ee-64c6140ad5ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Going to try to terminate instance {{(pid=132984) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:06:57.495113 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-bd3f1960-683d-42c1-aec0-25bc8f987948 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:57.504983 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-bd3f1960-683d-42c1-aec0-25bc8f987948 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:57.506781 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-bd3f1960-683d-42c1-aec0-25bc8f987948 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:57.508316 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-bd3f1960-683d-42c1-aec0-25bc8f987948 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.209754 Aug 24 09:06:57.509841 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 573/1169] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:57 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:57.609127 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0963ab04-637a-4915-b9ee-64c6140ad5ab tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "DELETE /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 204 len: 0 microversion: 2.1 time: 0.328491 Aug 24 09:06:57.613288 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 597/1170] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:06:57 2022] DELETE /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:06:57.618445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a37ba153-e156-4432-bf87-aa21d4035088 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:57.619111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a37ba153-e156-4432-bf87-aa21d4035088 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:57.625566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a37ba153-e156-4432-bf87-aa21d4035088 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:57.629797 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a37ba153-e156-4432-bf87-aa21d4035088 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:57.629797 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a37ba153-e156-4432-bf87-aa21d4035088 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:57.629797 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a37ba153-e156-4432-bf87-aa21d4035088 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:57.629797 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a37ba153-e156-4432-bf87-aa21d4035088 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:57.630158 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a37ba153-e156-4432-bf87-aa21d4035088 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:57.825636 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a37ba153-e156-4432-bf87-aa21d4035088 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:57.838686 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a37ba153-e156-4432-bf87-aa21d4035088 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.223993 Aug 24 09:06:57.839264 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 574/1171] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:57 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:58.534389 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-eacebb0a-1afd-45a1-aa40-def6cb59ef6f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:58.535052 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-eacebb0a-1afd-45a1-aa40-def6cb59ef6f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:58.541598 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eacebb0a-1afd-45a1-aa40-def6cb59ef6f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:58.542079 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eacebb0a-1afd-45a1-aa40-def6cb59ef6f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:58.542509 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eacebb0a-1afd-45a1-aa40-def6cb59ef6f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:58.543243 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eacebb0a-1afd-45a1-aa40-def6cb59ef6f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:58.544182 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eacebb0a-1afd-45a1-aa40-def6cb59ef6f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:58.544674 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-eacebb0a-1afd-45a1-aa40-def6cb59ef6f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:58.547480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:58.697841 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-eacebb0a-1afd-45a1-aa40-def6cb59ef6f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:58.706674 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-eacebb0a-1afd-45a1-aa40-def6cb59ef6f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:58.708180 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-eacebb0a-1afd-45a1-aa40-def6cb59ef6f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:58.709379 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-eacebb0a-1afd-45a1-aa40-def6cb59ef6f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.179847 Aug 24 09:06:58.709941 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 598/1172] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:58 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:58.862849 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6366b6e3-4a5b-4e03-9e43-6f9aca87d90f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:58.863680 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6366b6e3-4a5b-4e03-9e43-6f9aca87d90f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:58.870244 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6366b6e3-4a5b-4e03-9e43-6f9aca87d90f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:58.870725 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6366b6e3-4a5b-4e03-9e43-6f9aca87d90f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:58.871151 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6366b6e3-4a5b-4e03-9e43-6f9aca87d90f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:58.871879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6366b6e3-4a5b-4e03-9e43-6f9aca87d90f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:58.872333 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6366b6e3-4a5b-4e03-9e43-6f9aca87d90f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:58.872775 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6366b6e3-4a5b-4e03-9e43-6f9aca87d90f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:59.014503 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6366b6e3-4a5b-4e03-9e43-6f9aca87d90f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:59.022971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6366b6e3-4a5b-4e03-9e43-6f9aca87d90f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.163878 Aug 24 09:06:59.023611 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 575/1173] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:58 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:59.736918 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-839b04d4-5b96-4bcb-969e-104b6cbb92ac tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:59.737729 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-839b04d4-5b96-4bcb-969e-104b6cbb92ac tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:59.745402 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-839b04d4-5b96-4bcb-969e-104b6cbb92ac tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:59.745883 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-839b04d4-5b96-4bcb-969e-104b6cbb92ac tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:59.746317 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-839b04d4-5b96-4bcb-969e-104b6cbb92ac tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:59.747590 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-839b04d4-5b96-4bcb-969e-104b6cbb92ac tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:59.748035 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-839b04d4-5b96-4bcb-969e-104b6cbb92ac tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:59.748451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-839b04d4-5b96-4bcb-969e-104b6cbb92ac tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:59.914113 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-839b04d4-5b96-4bcb-969e-104b6cbb92ac tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:59.923405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-839b04d4-5b96-4bcb-969e-104b6cbb92ac tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:59.923736 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-839b04d4-5b96-4bcb-969e-104b6cbb92ac tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:59.924847 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-839b04d4-5b96-4bcb-969e-104b6cbb92ac tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.192316 Aug 24 09:06:59.925456 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 599/1174] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:59 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:00.050274 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-971ff596-da95-4ec8-965b-4bb785ed296e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:00.050274 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-971ff596-da95-4ec8-965b-4bb785ed296e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:00.055946 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-971ff596-da95-4ec8-965b-4bb785ed296e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:00.056769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-971ff596-da95-4ec8-965b-4bb785ed296e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:00.057403 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-971ff596-da95-4ec8-965b-4bb785ed296e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:00.058694 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-971ff596-da95-4ec8-965b-4bb785ed296e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:00.059339 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-971ff596-da95-4ec8-965b-4bb785ed296e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:00.059831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-971ff596-da95-4ec8-965b-4bb785ed296e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:00.217187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-971ff596-da95-4ec8-965b-4bb785ed296e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:00.226600 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-971ff596-da95-4ec8-965b-4bb785ed296e tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.184620 Aug 24 09:07:00.233240 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 576/1175] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:00 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:00.954971 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e1582844-59a1-4e4b-9d5e-f0035766df52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:00.957160 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e1582844-59a1-4e4b-9d5e-f0035766df52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:00.981877 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e1582844-59a1-4e4b-9d5e-f0035766df52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:00.985168 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e1582844-59a1-4e4b-9d5e-f0035766df52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:00.985705 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e1582844-59a1-4e4b-9d5e-f0035766df52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:00.986487 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e1582844-59a1-4e4b-9d5e-f0035766df52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:00.987016 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e1582844-59a1-4e4b-9d5e-f0035766df52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:00.987489 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e1582844-59a1-4e4b-9d5e-f0035766df52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:01.176212 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e1582844-59a1-4e4b-9d5e-f0035766df52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:01.193007 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e1582844-59a1-4e4b-9d5e-f0035766df52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:01.196237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e1582844-59a1-4e4b-9d5e-f0035766df52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:01.198479 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e1582844-59a1-4e4b-9d5e-f0035766df52 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.252602 Aug 24 09:07:01.200808 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 600/1176] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:00 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:01.249470 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ba28c828-7c53-4cd6-879c-405a475f7634 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:01.250318 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ba28c828-7c53-4cd6-879c-405a475f7634 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:01.257494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ba28c828-7c53-4cd6-879c-405a475f7634 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:01.258295 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ba28c828-7c53-4cd6-879c-405a475f7634 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:01.259139 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ba28c828-7c53-4cd6-879c-405a475f7634 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:01.260084 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ba28c828-7c53-4cd6-879c-405a475f7634 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:01.260577 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ba28c828-7c53-4cd6-879c-405a475f7634 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:01.263551 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ba28c828-7c53-4cd6-879c-405a475f7634 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:01.452772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ba28c828-7c53-4cd6-879c-405a475f7634 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:01.466735 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ba28c828-7c53-4cd6-879c-405a475f7634 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.221788 Aug 24 09:07:01.467745 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 577/1177] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:01 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:02.241202 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-057fa81f-f7dd-4914-a60b-19f3736b36ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:02.242112 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-057fa81f-f7dd-4914-a60b-19f3736b36ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:02.249089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-057fa81f-f7dd-4914-a60b-19f3736b36ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:02.249519 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-057fa81f-f7dd-4914-a60b-19f3736b36ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:02.249961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-057fa81f-f7dd-4914-a60b-19f3736b36ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:02.250876 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-057fa81f-f7dd-4914-a60b-19f3736b36ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:02.251523 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-057fa81f-f7dd-4914-a60b-19f3736b36ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:02.251961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-057fa81f-f7dd-4914-a60b-19f3736b36ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:02.415451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-057fa81f-f7dd-4914-a60b-19f3736b36ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:02.425412 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-057fa81f-f7dd-4914-a60b-19f3736b36ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:02.426934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-057fa81f-f7dd-4914-a60b-19f3736b36ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:02.428133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-057fa81f-f7dd-4914-a60b-19f3736b36ea tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.192670 Aug 24 09:07:02.428734 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 601/1178] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:02 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:02.489861 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5b54510f-fe5c-4ada-bd1c-07d3c07e6548 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:02.497074 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5b54510f-fe5c-4ada-bd1c-07d3c07e6548 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:02.499025 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5b54510f-fe5c-4ada-bd1c-07d3c07e6548 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:02.499517 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5b54510f-fe5c-4ada-bd1c-07d3c07e6548 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:02.500032 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5b54510f-fe5c-4ada-bd1c-07d3c07e6548 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:02.500805 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5b54510f-fe5c-4ada-bd1c-07d3c07e6548 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:02.501263 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5b54510f-fe5c-4ada-bd1c-07d3c07e6548 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:02.501691 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5b54510f-fe5c-4ada-bd1c-07d3c07e6548 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:02.648789 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5b54510f-fe5c-4ada-bd1c-07d3c07e6548 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:02.658856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5b54510f-fe5c-4ada-bd1c-07d3c07e6548 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.173099 Aug 24 09:07:02.659701 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 578/1179] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:02 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:03.367602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2023387487", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-320820006", "security_groups": [{"name": "tempest-secgroup-smoke-324555672"}], "block_device_mapping_v2": [{"uuid": "749b016d-f564-475d-a483-4e6a28e288a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a248e98a-364e-44f4-bc7f-3b491742a7df"}]}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:07:03.456528 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8307872f-4034-40c2-ba00-e8b5ee6fa90a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:03.457426 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8307872f-4034-40c2-ba00-e8b5ee6fa90a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:03.463208 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8307872f-4034-40c2-ba00-e8b5ee6fa90a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:03.463675 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8307872f-4034-40c2-ba00-e8b5ee6fa90a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:03.464101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8307872f-4034-40c2-ba00-e8b5ee6fa90a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:03.464808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8307872f-4034-40c2-ba00-e8b5ee6fa90a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:03.465768 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8307872f-4034-40c2-ba00-e8b5ee6fa90a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:03.466183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8307872f-4034-40c2-ba00-e8b5ee6fa90a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:03.487970 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.network.neutron [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] validate_networks() for [('a248e98a-364e-44f4-bc7f-3b491742a7df', None, None, None, None, None)] {{(pid=132984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:07:03.617571 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8307872f-4034-40c2-ba00-e8b5ee6fa90a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:03.627083 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8307872f-4034-40c2-ba00-e8b5ee6fa90a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:03.628742 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8307872f-4034-40c2-ba00-e8b5ee6fa90a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:03.630206 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8307872f-4034-40c2-ba00-e8b5ee6fa90a tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.177579 Aug 24 09:07:03.631533 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 579/1180] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:03 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:07:03.681333 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0bfc5730-e2dc-413f-892b-8ab9c006fd75 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:03.681948 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0bfc5730-e2dc-413f-892b-8ab9c006fd75 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:03.688325 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0bfc5730-e2dc-413f-892b-8ab9c006fd75 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:03.688792 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0bfc5730-e2dc-413f-892b-8ab9c006fd75 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:03.689234 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0bfc5730-e2dc-413f-892b-8ab9c006fd75 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:03.689971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0bfc5730-e2dc-413f-892b-8ab9c006fd75 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:03.690632 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0bfc5730-e2dc-413f-892b-8ab9c006fd75 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:03.691062 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0bfc5730-e2dc-413f-892b-8ab9c006fd75 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:03.864711 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0bfc5730-e2dc-413f-892b-8ab9c006fd75 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:03.874176 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0bfc5730-e2dc-413f-892b-8ab9c006fd75 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.196661 Aug 24 09:07:03.875536 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 580/1181] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:03 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:04.242262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Flavor limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:07:04.243013 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Image limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:07:04.243549 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Flavor pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:07:04.243959 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Image pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:07:04.244367 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:07:04.255616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:04.256101 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:04.256533 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:04.257305 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:04.257777 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:04.258211 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:04.277466 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Getting quotas for project 1f01e21018a54220ba1e54c6b7bfc400. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:07:04.287904 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Getting quotas for user c2c3752027f342a489e6eb9d3b540819 and project 1f01e21018a54220ba1e54c6b7bfc400. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:07:04.348801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Going to run 1 instances... {{(pid=132984) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:07:04.350913 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='749b016d-f564-475d-a483-4e6a28e288a1',volume_size=None,volume_type=None)] {{(pid=132984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:07:04.656039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-45d6be7a-ce2d-4405-beb0-5ac0c923d716 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:04.657272 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-45d6be7a-ce2d-4405-beb0-5ac0c923d716 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:04.664321 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-45d6be7a-ce2d-4405-beb0-5ac0c923d716 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:04.664827 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-45d6be7a-ce2d-4405-beb0-5ac0c923d716 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:04.665265 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-45d6be7a-ce2d-4405-beb0-5ac0c923d716 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:04.666104 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-45d6be7a-ce2d-4405-beb0-5ac0c923d716 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:04.666560 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-45d6be7a-ce2d-4405-beb0-5ac0c923d716 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:04.666982 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-45d6be7a-ce2d-4405-beb0-5ac0c923d716 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:04.825751 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-45d6be7a-ce2d-4405-beb0-5ac0c923d716 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:04.835677 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-45d6be7a-ce2d-4405-beb0-5ac0c923d716 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:04.841166 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-45d6be7a-ce2d-4405-beb0-5ac0c923d716 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:04.841166 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-45d6be7a-ce2d-4405-beb0-5ac0c923d716 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.188422 Aug 24 09:07:04.841166 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 581/1182] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:04 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:07:04.847242 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4332b41d-d37e-4f50-97cb-782e446ff440 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.483674 Aug 24 09:07:04.848967 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 602/1183] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 09:07:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:07:04.859926 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8756c295-66c3-4646-bfe4-f2f35968f10d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:04.860543 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8756c295-66c3-4646-bfe4-f2f35968f10d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:04.896749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-586f6702-0dbe-41f5-9e93-aa66f072506f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:04.897369 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-586f6702-0dbe-41f5-9e93-aa66f072506f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:04.913667 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-586f6702-0dbe-41f5-9e93-aa66f072506f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:04.914406 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-586f6702-0dbe-41f5-9e93-aa66f072506f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:04.917077 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-586f6702-0dbe-41f5-9e93-aa66f072506f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:04.917993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-586f6702-0dbe-41f5-9e93-aa66f072506f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:04.919173 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-586f6702-0dbe-41f5-9e93-aa66f072506f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:04.921115 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-586f6702-0dbe-41f5-9e93-aa66f072506f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:04.935526 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8756c295-66c3-4646-bfe4-f2f35968f10d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:04.944556 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8756c295-66c3-4646-bfe4-f2f35968f10d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1094 microversion: 2.1 time: 0.089057 Aug 24 09:07:04.946148 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 582/1184] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:04 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:05.105510 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-586f6702-0dbe-41f5-9e93-aa66f072506f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:05.113349 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-586f6702-0dbe-41f5-9e93-aa66f072506f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.220550 Aug 24 09:07:05.113928 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 603/1185] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:04 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:05.863360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b7e3b625-e88e-4929-83a3-6dc2e2ee9097 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:05.863975 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b7e3b625-e88e-4929-83a3-6dc2e2ee9097 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:05.871226 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b7e3b625-e88e-4929-83a3-6dc2e2ee9097 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:05.871707 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b7e3b625-e88e-4929-83a3-6dc2e2ee9097 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:05.872144 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b7e3b625-e88e-4929-83a3-6dc2e2ee9097 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:05.873439 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b7e3b625-e88e-4929-83a3-6dc2e2ee9097 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:05.873947 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b7e3b625-e88e-4929-83a3-6dc2e2ee9097 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:05.874392 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b7e3b625-e88e-4929-83a3-6dc2e2ee9097 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:05.966708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3ded0add-edab-4de3-8a7d-8c5f11650cf2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:05.967327 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3ded0add-edab-4de3-8a7d-8c5f11650cf2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:05.978489 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ded0add-edab-4de3-8a7d-8c5f11650cf2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:05.979128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ded0add-edab-4de3-8a7d-8c5f11650cf2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:05.979711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ded0add-edab-4de3-8a7d-8c5f11650cf2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:05.980437 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ded0add-edab-4de3-8a7d-8c5f11650cf2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:06.008869 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ded0add-edab-4de3-8a7d-8c5f11650cf2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:06.009687 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3ded0add-edab-4de3-8a7d-8c5f11650cf2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:06.017811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b7e3b625-e88e-4929-83a3-6dc2e2ee9097 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:06.026964 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b7e3b625-e88e-4929-83a3-6dc2e2ee9097 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:06.028675 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b7e3b625-e88e-4929-83a3-6dc2e2ee9097 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:06.029978 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b7e3b625-e88e-4929-83a3-6dc2e2ee9097 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.170649 Aug 24 09:07:06.030622 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 583/1186] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:05 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:06.086434 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3ded0add-edab-4de3-8a7d-8c5f11650cf2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:06.097177 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3ded0add-edab-4de3-8a7d-8c5f11650cf2 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1144 microversion: 2.1 time: 0.134993 Aug 24 09:07:06.098272 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 604/1187] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:05 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1144 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:06.134656 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6313d085-8453-49da-a874-dcdf56711bf6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:06.135269 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6313d085-8453-49da-a874-dcdf56711bf6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:06.141590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6313d085-8453-49da-a874-dcdf56711bf6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:06.142074 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6313d085-8453-49da-a874-dcdf56711bf6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:06.142509 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6313d085-8453-49da-a874-dcdf56711bf6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:06.143222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6313d085-8453-49da-a874-dcdf56711bf6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:06.143671 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6313d085-8453-49da-a874-dcdf56711bf6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:06.144090 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6313d085-8453-49da-a874-dcdf56711bf6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:06.289461 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6313d085-8453-49da-a874-dcdf56711bf6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:06.299292 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6313d085-8453-49da-a874-dcdf56711bf6 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.168580 Aug 24 09:07:06.300067 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 584/1188] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:06 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:07.064974 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-16a86e01-576a-4e70-8396-0a05c8b997c4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:07.065881 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-16a86e01-576a-4e70-8396-0a05c8b997c4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:07.072952 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16a86e01-576a-4e70-8396-0a05c8b997c4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:07.073437 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16a86e01-576a-4e70-8396-0a05c8b997c4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:07.073873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16a86e01-576a-4e70-8396-0a05c8b997c4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:07.074615 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16a86e01-576a-4e70-8396-0a05c8b997c4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:07.075070 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16a86e01-576a-4e70-8396-0a05c8b997c4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:07.075500 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-16a86e01-576a-4e70-8396-0a05c8b997c4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:07.119179 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0c217f94-f647-46f7-90a7-586109ba1b8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:07.120175 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0c217f94-f647-46f7-90a7-586109ba1b8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:07.130741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0c217f94-f647-46f7-90a7-586109ba1b8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:07.135677 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0c217f94-f647-46f7-90a7-586109ba1b8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:07.135677 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0c217f94-f647-46f7-90a7-586109ba1b8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:07.135677 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0c217f94-f647-46f7-90a7-586109ba1b8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:07.135677 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0c217f94-f647-46f7-90a7-586109ba1b8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:07.136187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0c217f94-f647-46f7-90a7-586109ba1b8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:07.228731 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0c217f94-f647-46f7-90a7-586109ba1b8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:07.236891 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0c217f94-f647-46f7-90a7-586109ba1b8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1144 microversion: 2.1 time: 0.121855 Aug 24 09:07:07.237661 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 585/1189] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:07 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1144 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:07.258098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-16a86e01-576a-4e70-8396-0a05c8b997c4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:07.268147 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-16a86e01-576a-4e70-8396-0a05c8b997c4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:07.269687 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-16a86e01-576a-4e70-8396-0a05c8b997c4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:07.270870 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-16a86e01-576a-4e70-8396-0a05c8b997c4 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.210125 Aug 24 09:07:07.271424 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 605/1190] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:07 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:07.321793 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-50bc950b-e622-4b6a-832d-2e14c6cfdfd0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:07.322324 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-50bc950b-e622-4b6a-832d-2e14c6cfdfd0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:07.329038 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-50bc950b-e622-4b6a-832d-2e14c6cfdfd0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:07.329522 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-50bc950b-e622-4b6a-832d-2e14c6cfdfd0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:07.330453 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-50bc950b-e622-4b6a-832d-2e14c6cfdfd0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:07.330655 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-50bc950b-e622-4b6a-832d-2e14c6cfdfd0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:07.331105 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-50bc950b-e622-4b6a-832d-2e14c6cfdfd0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:07.331529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-50bc950b-e622-4b6a-832d-2e14c6cfdfd0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:07.492132 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-50bc950b-e622-4b6a-832d-2e14c6cfdfd0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:07.501077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-50bc950b-e622-4b6a-832d-2e14c6cfdfd0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.183058 Aug 24 09:07:07.501868 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 586/1191] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:07 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:08.258082 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c30732a7-f48d-451e-8f9f-63b774114f8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:08.258720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c30732a7-f48d-451e-8f9f-63b774114f8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:08.266062 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c30732a7-f48d-451e-8f9f-63b774114f8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:08.266524 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c30732a7-f48d-451e-8f9f-63b774114f8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:08.266944 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c30732a7-f48d-451e-8f9f-63b774114f8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:08.267640 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c30732a7-f48d-451e-8f9f-63b774114f8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:08.268080 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c30732a7-f48d-451e-8f9f-63b774114f8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:08.268493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c30732a7-f48d-451e-8f9f-63b774114f8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:08.293814 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c05cdf9d-e23e-40a1-be31-4188e9269485 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:08.294440 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-c05cdf9d-e23e-40a1-be31-4188e9269485 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:08.300868 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c05cdf9d-e23e-40a1-be31-4188e9269485 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:08.301349 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c05cdf9d-e23e-40a1-be31-4188e9269485 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:08.301774 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c05cdf9d-e23e-40a1-be31-4188e9269485 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:08.302460 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c05cdf9d-e23e-40a1-be31-4188e9269485 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:08.302901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c05cdf9d-e23e-40a1-be31-4188e9269485 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:08.303315 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-c05cdf9d-e23e-40a1-be31-4188e9269485 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:08.335506 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c30732a7-f48d-451e-8f9f-63b774114f8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:08.342602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c30732a7-f48d-451e-8f9f-63b774114f8f tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1144 microversion: 2.1 time: 0.088425 Aug 24 09:07:08.343840 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 606/1192] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:08 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:08.444948 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c05cdf9d-e23e-40a1-be31-4188e9269485 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:08.453779 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c05cdf9d-e23e-40a1-be31-4188e9269485 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:08.455469 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-c05cdf9d-e23e-40a1-be31-4188e9269485 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:08.456737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c05cdf9d-e23e-40a1-be31-4188e9269485 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.166733 Aug 24 09:07:08.457339 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 587/1193] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:08 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:07:08.523298 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a2353929-7abf-4725-bcc1-55b44ed6858f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:08.524317 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a2353929-7abf-4725-bcc1-55b44ed6858f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:08.530021 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2353929-7abf-4725-bcc1-55b44ed6858f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:08.530530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2353929-7abf-4725-bcc1-55b44ed6858f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:08.530971 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2353929-7abf-4725-bcc1-55b44ed6858f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:08.531660 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2353929-7abf-4725-bcc1-55b44ed6858f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:08.532244 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2353929-7abf-4725-bcc1-55b44ed6858f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:08.532595 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2353929-7abf-4725-bcc1-55b44ed6858f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:08.659377 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a2353929-7abf-4725-bcc1-55b44ed6858f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:08.667199 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a2353929-7abf-4725-bcc1-55b44ed6858f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.147780 Aug 24 09:07:08.667698 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 607/1194] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:08 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:09.363374 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1021974d-5d65-4ba9-974b-08b988d2ddbe tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:09.363988 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1021974d-5d65-4ba9-974b-08b988d2ddbe tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:09.370448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1021974d-5d65-4ba9-974b-08b988d2ddbe tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:09.370923 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1021974d-5d65-4ba9-974b-08b988d2ddbe tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:09.371349 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1021974d-5d65-4ba9-974b-08b988d2ddbe tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:09.372044 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1021974d-5d65-4ba9-974b-08b988d2ddbe tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:09.372487 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1021974d-5d65-4ba9-974b-08b988d2ddbe tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:09.372943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1021974d-5d65-4ba9-974b-08b988d2ddbe tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:09.438330 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1021974d-5d65-4ba9-974b-08b988d2ddbe tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:09.446092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1021974d-5d65-4ba9-974b-08b988d2ddbe tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1144 microversion: 2.1 time: 0.086598 Aug 24 09:07:09.446662 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 588/1195] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:09 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:09.479477 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-35f08106-4bbf-4e89-a299-65434a81e12c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:09.480036 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-35f08106-4bbf-4e89-a299-65434a81e12c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:09.487275 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-35f08106-4bbf-4e89-a299-65434a81e12c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:09.487758 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-35f08106-4bbf-4e89-a299-65434a81e12c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:09.488190 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-35f08106-4bbf-4e89-a299-65434a81e12c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:09.488919 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-35f08106-4bbf-4e89-a299-65434a81e12c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:09.489368 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-35f08106-4bbf-4e89-a299-65434a81e12c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:09.489789 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-35f08106-4bbf-4e89-a299-65434a81e12c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:09.626896 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-35f08106-4bbf-4e89-a299-65434a81e12c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:09.635286 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-35f08106-4bbf-4e89-a299-65434a81e12c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:09.636823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-35f08106-4bbf-4e89-a299-65434a81e12c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:09.637986 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-35f08106-4bbf-4e89-a299-65434a81e12c tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.162550 Aug 24 09:07:09.638540 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 608/1196] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:09 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:07:09.690076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4506e77c-b26d-4d93-b72a-666f841f0aff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:09.690710 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4506e77c-b26d-4d93-b72a-666f841f0aff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:09.696761 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4506e77c-b26d-4d93-b72a-666f841f0aff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:09.697243 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4506e77c-b26d-4d93-b72a-666f841f0aff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:09.697676 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4506e77c-b26d-4d93-b72a-666f841f0aff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:09.698363 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4506e77c-b26d-4d93-b72a-666f841f0aff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:09.698811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4506e77c-b26d-4d93-b72a-666f841f0aff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:09.699231 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4506e77c-b26d-4d93-b72a-666f841f0aff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:09.831765 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4506e77c-b26d-4d93-b72a-666f841f0aff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:09.839544 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4506e77c-b26d-4d93-b72a-666f841f0aff tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.154050 Aug 24 09:07:09.840088 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 589/1197] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:09 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:10.466969 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5cb580b8-730f-427a-b671-e25096ef9798 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:10.467482 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5cb580b8-730f-427a-b671-e25096ef9798 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:10.473594 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5cb580b8-730f-427a-b671-e25096ef9798 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:10.474074 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5cb580b8-730f-427a-b671-e25096ef9798 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:10.474513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5cb580b8-730f-427a-b671-e25096ef9798 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:10.475243 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5cb580b8-730f-427a-b671-e25096ef9798 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:10.475632 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5cb580b8-730f-427a-b671-e25096ef9798 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:10.476048 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5cb580b8-730f-427a-b671-e25096ef9798 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:10.542015 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5cb580b8-730f-427a-b671-e25096ef9798 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:10.550602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5cb580b8-730f-427a-b671-e25096ef9798 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1144 microversion: 2.1 time: 0.087423 Aug 24 09:07:10.551207 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 609/1198] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:10 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:10.662163 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0506000b-1d25-43e5-8cf4-7666271a5904 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:10.662760 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0506000b-1d25-43e5-8cf4-7666271a5904 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:10.669945 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0506000b-1d25-43e5-8cf4-7666271a5904 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:10.670441 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0506000b-1d25-43e5-8cf4-7666271a5904 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:10.670882 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0506000b-1d25-43e5-8cf4-7666271a5904 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:10.672102 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0506000b-1d25-43e5-8cf4-7666271a5904 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:10.672578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0506000b-1d25-43e5-8cf4-7666271a5904 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:10.673007 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0506000b-1d25-43e5-8cf4-7666271a5904 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:10.693638 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:10.809434 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0506000b-1d25-43e5-8cf4-7666271a5904 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:10.818985 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0506000b-1d25-43e5-8cf4-7666271a5904 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:10.820496 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0506000b-1d25-43e5-8cf4-7666271a5904 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:10.821722 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0506000b-1d25-43e5-8cf4-7666271a5904 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.163888 Aug 24 09:07:10.822297 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 590/1199] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:10 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:10.861490 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-830cd466-0404-4342-9620-cb4df876ab40 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:10.862092 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-830cd466-0404-4342-9620-cb4df876ab40 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:10.868059 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-830cd466-0404-4342-9620-cb4df876ab40 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:10.868530 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-830cd466-0404-4342-9620-cb4df876ab40 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:10.869038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-830cd466-0404-4342-9620-cb4df876ab40 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:10.869727 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-830cd466-0404-4342-9620-cb4df876ab40 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:10.870170 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-830cd466-0404-4342-9620-cb4df876ab40 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:10.870585 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-830cd466-0404-4342-9620-cb4df876ab40 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:11.011474 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-830cd466-0404-4342-9620-cb4df876ab40 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:11.019751 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-830cd466-0404-4342-9620-cb4df876ab40 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.162675 Aug 24 09:07:11.020360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 610/1200] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:10 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:11.572254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-257c88cc-27d8-4d78-a837-0079b6821732 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:11.572986 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-257c88cc-27d8-4d78-a837-0079b6821732 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:11.580419 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-257c88cc-27d8-4d78-a837-0079b6821732 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:11.580921 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-257c88cc-27d8-4d78-a837-0079b6821732 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:11.581349 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-257c88cc-27d8-4d78-a837-0079b6821732 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:11.582044 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-257c88cc-27d8-4d78-a837-0079b6821732 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:11.582484 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-257c88cc-27d8-4d78-a837-0079b6821732 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:11.582894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-257c88cc-27d8-4d78-a837-0079b6821732 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:11.648672 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-257c88cc-27d8-4d78-a837-0079b6821732 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:11.657086 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-257c88cc-27d8-4d78-a837-0079b6821732 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1144 microversion: 2.1 time: 0.088722 Aug 24 09:07:11.657665 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 591/1201] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:11 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:11.845478 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f4ed77d0-668d-4d3a-ba96-eb4e76d70abb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:11.846042 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f4ed77d0-668d-4d3a-ba96-eb4e76d70abb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:11.852833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f4ed77d0-668d-4d3a-ba96-eb4e76d70abb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:11.853314 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f4ed77d0-668d-4d3a-ba96-eb4e76d70abb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:11.853771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f4ed77d0-668d-4d3a-ba96-eb4e76d70abb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:11.854449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f4ed77d0-668d-4d3a-ba96-eb4e76d70abb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:11.854898 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f4ed77d0-668d-4d3a-ba96-eb4e76d70abb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:11.855321 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f4ed77d0-668d-4d3a-ba96-eb4e76d70abb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:11.992954 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f4ed77d0-668d-4d3a-ba96-eb4e76d70abb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:12.002440 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f4ed77d0-668d-4d3a-ba96-eb4e76d70abb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:12.003956 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f4ed77d0-668d-4d3a-ba96-eb4e76d70abb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:12.005177 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f4ed77d0-668d-4d3a-ba96-eb4e76d70abb tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.163805 Aug 24 09:07:12.005759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 611/1202] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:11 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:12.050113 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-de28c60f-1091-4317-b1f4-dbda4797f9d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:12.050705 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-de28c60f-1091-4317-b1f4-dbda4797f9d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:12.057382 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de28c60f-1091-4317-b1f4-dbda4797f9d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:12.057898 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de28c60f-1091-4317-b1f4-dbda4797f9d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:12.058789 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de28c60f-1091-4317-b1f4-dbda4797f9d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:12.058971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de28c60f-1091-4317-b1f4-dbda4797f9d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:12.059416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de28c60f-1091-4317-b1f4-dbda4797f9d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:12.059833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-de28c60f-1091-4317-b1f4-dbda4797f9d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:12.198208 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-de28c60f-1091-4317-b1f4-dbda4797f9d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:12.207976 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-de28c60f-1091-4317-b1f4-dbda4797f9d0 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.161345 Aug 24 09:07:12.209039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 592/1203] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:12 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:12.678756 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-fbe01091-ef2e-4859-8129-885da4ac3e11 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:12.679371 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-fbe01091-ef2e-4859-8129-885da4ac3e11 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:12.685626 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbe01091-ef2e-4859-8129-885da4ac3e11 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:12.686108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbe01091-ef2e-4859-8129-885da4ac3e11 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:12.686547 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbe01091-ef2e-4859-8129-885da4ac3e11 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:12.687255 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbe01091-ef2e-4859-8129-885da4ac3e11 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:12.687712 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbe01091-ef2e-4859-8129-885da4ac3e11 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:12.688134 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-fbe01091-ef2e-4859-8129-885da4ac3e11 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:12.752562 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-fbe01091-ef2e-4859-8129-885da4ac3e11 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:12.761124 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-fbe01091-ef2e-4859-8129-885da4ac3e11 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1144 microversion: 2.1 time: 0.086159 Aug 24 09:07:12.761720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 612/1204] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:12 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:13.028902 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7044ac23-b9af-4fd7-9771-db93fe40b20b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:13.029416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-7044ac23-b9af-4fd7-9771-db93fe40b20b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:13.036285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7044ac23-b9af-4fd7-9771-db93fe40b20b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:13.036797 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7044ac23-b9af-4fd7-9771-db93fe40b20b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:13.037225 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7044ac23-b9af-4fd7-9771-db93fe40b20b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:13.037918 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7044ac23-b9af-4fd7-9771-db93fe40b20b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:13.038355 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7044ac23-b9af-4fd7-9771-db93fe40b20b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:13.038778 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7044ac23-b9af-4fd7-9771-db93fe40b20b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:13.182179 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7044ac23-b9af-4fd7-9771-db93fe40b20b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:13.193997 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7044ac23-b9af-4fd7-9771-db93fe40b20b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:13.195865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7044ac23-b9af-4fd7-9771-db93fe40b20b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:13.197278 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7044ac23-b9af-4fd7-9771-db93fe40b20b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.172323 Aug 24 09:07:13.198116 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 593/1205] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:13 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:07:13.245791 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b299e63e-a277-4f99-bfd4-fbd3f786a476 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:13.246405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b299e63e-a277-4f99-bfd4-fbd3f786a476 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:13.253486 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b299e63e-a277-4f99-bfd4-fbd3f786a476 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:13.253960 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b299e63e-a277-4f99-bfd4-fbd3f786a476 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:13.254385 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b299e63e-a277-4f99-bfd4-fbd3f786a476 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:13.255080 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b299e63e-a277-4f99-bfd4-fbd3f786a476 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:13.255527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b299e63e-a277-4f99-bfd4-fbd3f786a476 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:13.255944 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b299e63e-a277-4f99-bfd4-fbd3f786a476 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:13.399181 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b299e63e-a277-4f99-bfd4-fbd3f786a476 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:13.410008 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b299e63e-a277-4f99-bfd4-fbd3f786a476 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.167719 Aug 24 09:07:13.410844 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 613/1206] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:13 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:13.783672 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-476c4609-25d1-4875-9734-7b3058254111 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:13.784560 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-476c4609-25d1-4875-9734-7b3058254111 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:13.791127 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-476c4609-25d1-4875-9734-7b3058254111 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:13.791621 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-476c4609-25d1-4875-9734-7b3058254111 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:13.792055 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-476c4609-25d1-4875-9734-7b3058254111 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:13.792852 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-476c4609-25d1-4875-9734-7b3058254111 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:13.793345 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-476c4609-25d1-4875-9734-7b3058254111 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:13.793790 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-476c4609-25d1-4875-9734-7b3058254111 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:13.864888 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-476c4609-25d1-4875-9734-7b3058254111 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:13.873181 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-476c4609-25d1-4875-9734-7b3058254111 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1144 microversion: 2.1 time: 0.093511 Aug 24 09:07:13.873764 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 594/1207] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:13 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:14.222304 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-37d9caab-430d-49b0-b6b0-ac3489ff7b81 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:14.224719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-37d9caab-430d-49b0-b6b0-ac3489ff7b81 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:14.229329 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-37d9caab-430d-49b0-b6b0-ac3489ff7b81 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:14.229823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-37d9caab-430d-49b0-b6b0-ac3489ff7b81 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:14.230263 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-37d9caab-430d-49b0-b6b0-ac3489ff7b81 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:14.230980 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-37d9caab-430d-49b0-b6b0-ac3489ff7b81 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:14.231435 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-37d9caab-430d-49b0-b6b0-ac3489ff7b81 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:14.231867 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-37d9caab-430d-49b0-b6b0-ac3489ff7b81 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:14.266348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:14.297742 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=6 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:14.387480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-37d9caab-430d-49b0-b6b0-ac3489ff7b81 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:14.396685 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-37d9caab-430d-49b0-b6b0-ac3489ff7b81 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:14.398179 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-37d9caab-430d-49b0-b6b0-ac3489ff7b81 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:14.399334 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-37d9caab-430d-49b0-b6b0-ac3489ff7b81 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.181928 Aug 24 09:07:14.399904 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 614/1208] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:14 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:14.435000 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9492a25a-570d-4a04-8217-a645f0afcbf1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:14.435551 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-9492a25a-570d-4a04-8217-a645f0afcbf1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:14.442137 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9492a25a-570d-4a04-8217-a645f0afcbf1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:14.442610 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9492a25a-570d-4a04-8217-a645f0afcbf1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:14.443039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9492a25a-570d-4a04-8217-a645f0afcbf1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:14.443720 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9492a25a-570d-4a04-8217-a645f0afcbf1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:14.444164 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9492a25a-570d-4a04-8217-a645f0afcbf1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:14.444602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-9492a25a-570d-4a04-8217-a645f0afcbf1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:14.584829 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-9492a25a-570d-4a04-8217-a645f0afcbf1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:14.592837 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9492a25a-570d-4a04-8217-a645f0afcbf1 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.161859 Aug 24 09:07:14.594058 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 595/1209] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:14 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:14.897353 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5882b4e1-3337-4a13-8aa5-ff4e98d3cbfc tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:14.897959 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5882b4e1-3337-4a13-8aa5-ff4e98d3cbfc tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:14.904425 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5882b4e1-3337-4a13-8aa5-ff4e98d3cbfc tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:14.904930 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5882b4e1-3337-4a13-8aa5-ff4e98d3cbfc tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:14.905358 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5882b4e1-3337-4a13-8aa5-ff4e98d3cbfc tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:14.906107 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5882b4e1-3337-4a13-8aa5-ff4e98d3cbfc tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:14.906588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5882b4e1-3337-4a13-8aa5-ff4e98d3cbfc tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:14.907005 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5882b4e1-3337-4a13-8aa5-ff4e98d3cbfc tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:14.923079 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:14.970194 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5882b4e1-3337-4a13-8aa5-ff4e98d3cbfc tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:14.978266 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5882b4e1-3337-4a13-8aa5-ff4e98d3cbfc tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1144 microversion: 2.1 time: 0.086013 Aug 24 09:07:14.978881 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 615/1210] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:14 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:15.433705 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4160fd76-514f-4d29-b0b3-350025a244b9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:15.434319 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4160fd76-514f-4d29-b0b3-350025a244b9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:15.436390 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:15.442444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4160fd76-514f-4d29-b0b3-350025a244b9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:15.442944 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4160fd76-514f-4d29-b0b3-350025a244b9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:15.443383 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4160fd76-514f-4d29-b0b3-350025a244b9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:15.444130 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4160fd76-514f-4d29-b0b3-350025a244b9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:15.444636 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4160fd76-514f-4d29-b0b3-350025a244b9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:15.445071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4160fd76-514f-4d29-b0b3-350025a244b9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:15.594024 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4160fd76-514f-4d29-b0b3-350025a244b9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:15.602914 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4160fd76-514f-4d29-b0b3-350025a244b9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:15.604430 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4160fd76-514f-4d29-b0b3-350025a244b9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:15.605674 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4160fd76-514f-4d29-b0b3-350025a244b9 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.186079 Aug 24 09:07:15.606235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 596/1211] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:15 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:15.616400 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9d951bcd-9f40-4ef0-b235-16bc4ee50e32 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:15.617117 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9d951bcd-9f40-4ef0-b235-16bc4ee50e32 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:15.627757 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d951bcd-9f40-4ef0-b235-16bc4ee50e32 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:15.628328 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d951bcd-9f40-4ef0-b235-16bc4ee50e32 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:15.629179 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d951bcd-9f40-4ef0-b235-16bc4ee50e32 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:15.630471 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d951bcd-9f40-4ef0-b235-16bc4ee50e32 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:15.631308 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d951bcd-9f40-4ef0-b235-16bc4ee50e32 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:15.632919 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9d951bcd-9f40-4ef0-b235-16bc4ee50e32 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:15.777722 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-9d951bcd-9f40-4ef0-b235-16bc4ee50e32 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:15.786489 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9d951bcd-9f40-4ef0-b235-16bc4ee50e32 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.174751 Aug 24 09:07:15.790150 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 616/1212] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:15 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:15.999913 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8f7daadd-4d52-45b8-a13b-52cb458e7f9d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:16.000475 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8f7daadd-4d52-45b8-a13b-52cb458e7f9d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:16.006893 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f7daadd-4d52-45b8-a13b-52cb458e7f9d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:16.007471 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f7daadd-4d52-45b8-a13b-52cb458e7f9d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:16.007911 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f7daadd-4d52-45b8-a13b-52cb458e7f9d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:16.008792 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f7daadd-4d52-45b8-a13b-52cb458e7f9d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:16.009346 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f7daadd-4d52-45b8-a13b-52cb458e7f9d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:16.009864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8f7daadd-4d52-45b8-a13b-52cb458e7f9d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:16.091740 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8f7daadd-4d52-45b8-a13b-52cb458e7f9d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:16.106071 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8f7daadd-4d52-45b8-a13b-52cb458e7f9d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1192 microversion: 2.1 time: 0.109790 Aug 24 09:07:16.107232 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 597/1213] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:15 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:16.630518 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a2289ab1-99c3-4bf5-86a9-267995ba92e8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:16.631132 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a2289ab1-99c3-4bf5-86a9-267995ba92e8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:16.643447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2289ab1-99c3-4bf5-86a9-267995ba92e8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:16.643934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2289ab1-99c3-4bf5-86a9-267995ba92e8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:16.644370 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2289ab1-99c3-4bf5-86a9-267995ba92e8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:16.645890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2289ab1-99c3-4bf5-86a9-267995ba92e8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:16.646360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2289ab1-99c3-4bf5-86a9-267995ba92e8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:16.646792 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a2289ab1-99c3-4bf5-86a9-267995ba92e8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:16.808438 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-89e1dbf2-f408-4555-9e80-0d1b447281e2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:16.809106 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-89e1dbf2-f408-4555-9e80-0d1b447281e2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:16.822530 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-89e1dbf2-f408-4555-9e80-0d1b447281e2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:16.825651 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-89e1dbf2-f408-4555-9e80-0d1b447281e2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:16.832256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-89e1dbf2-f408-4555-9e80-0d1b447281e2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:16.832256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-89e1dbf2-f408-4555-9e80-0d1b447281e2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:16.832256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-89e1dbf2-f408-4555-9e80-0d1b447281e2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:16.832256 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-89e1dbf2-f408-4555-9e80-0d1b447281e2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:16.856864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a2289ab1-99c3-4bf5-86a9-267995ba92e8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:16.892236 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a2289ab1-99c3-4bf5-86a9-267995ba92e8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:16.892236 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a2289ab1-99c3-4bf5-86a9-267995ba92e8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:16.892236 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a2289ab1-99c3-4bf5-86a9-267995ba92e8 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.249210 Aug 24 09:07:16.892519 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 617/1214] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:16 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:17.080649 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-89e1dbf2-f408-4555-9e80-0d1b447281e2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:17.089947 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-89e1dbf2-f408-4555-9e80-0d1b447281e2 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1673 microversion: 2.1 time: 0.285456 Aug 24 09:07:17.090938 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 598/1215] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:16 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1673 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:17.130483 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1391616c-aec2-4fe1-9b2a-1645d8f0bec8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:17.131091 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1391616c-aec2-4fe1-9b2a-1645d8f0bec8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:17.138312 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1391616c-aec2-4fe1-9b2a-1645d8f0bec8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:17.138846 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1391616c-aec2-4fe1-9b2a-1645d8f0bec8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:17.139303 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1391616c-aec2-4fe1-9b2a-1645d8f0bec8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:17.140533 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1391616c-aec2-4fe1-9b2a-1645d8f0bec8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:17.141033 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1391616c-aec2-4fe1-9b2a-1645d8f0bec8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:17.141455 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1391616c-aec2-4fe1-9b2a-1645d8f0bec8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:17.213703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1391616c-aec2-4fe1-9b2a-1645d8f0bec8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:17.224052 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1391616c-aec2-4fe1-9b2a-1645d8f0bec8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1210 microversion: 2.1 time: 0.097458 Aug 24 09:07:17.227302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 618/1216] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:17 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:17.413478 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-9acfda8c-b78d-4901-8899-95b4577ee8bf req-f9cfcd23-42ae-4f11-a782-a1c5cdbe7e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3a6687-812a-4169-96f5-0e7e9f3af30f", "name": "network-vif-deleted", "tag": "4e7b91b0-5780-4eab-adff-f304152da4c2"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:07:17.425633 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-9acfda8c-b78d-4901-8899-95b4577ee8bf req-f9cfcd23-42ae-4f11-a782-a1c5cdbe7e9b service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:17.427252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-9acfda8c-b78d-4901-8899-95b4577ee8bf req-f9cfcd23-42ae-4f11-a782-a1c5cdbe7e9b service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:17.427843 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-9acfda8c-b78d-4901-8899-95b4577ee8bf req-f9cfcd23-42ae-4f11-a782-a1c5cdbe7e9b service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:17.446510 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-9acfda8c-b78d-4901-8899-95b4577ee8bf req-f9cfcd23-42ae-4f11-a782-a1c5cdbe7e9b service nova] Creating event network-vif-deleted:4e7b91b0-5780-4eab-adff-f304152da4c2 for instance db3a6687-812a-4169-96f5-0e7e9f3af30f on hv-cinder-85221 Aug 24 09:07:17.453000 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-9acfda8c-b78d-4901-8899-95b4577ee8bf req-f9cfcd23-42ae-4f11-a782-a1c5cdbe7e9b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043696 Aug 24 09:07:17.454334 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 599/1217] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:07:17.900841 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a9ade4f3-5174-4876-af22-4807e66b8b83 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:17.902215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a9ade4f3-5174-4876-af22-4807e66b8b83 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:17.916184 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9ade4f3-5174-4876-af22-4807e66b8b83 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:17.916811 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9ade4f3-5174-4876-af22-4807e66b8b83 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:17.917492 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9ade4f3-5174-4876-af22-4807e66b8b83 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:17.918733 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9ade4f3-5174-4876-af22-4807e66b8b83 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:17.919703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9ade4f3-5174-4876-af22-4807e66b8b83 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:17.921672 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9ade4f3-5174-4876-af22-4807e66b8b83 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:18.114329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:18.115914 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:18.123048 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:18.124117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:18.124896 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:18.126156 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:18.126907 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:18.127547 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:18.149385 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a9ade4f3-5174-4876-af22-4807e66b8b83 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:18.187282 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a9ade4f3-5174-4876-af22-4807e66b8b83 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:18.208780 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a9ade4f3-5174-4876-af22-4807e66b8b83 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:18.213863 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a9ade4f3-5174-4876-af22-4807e66b8b83 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.314384 Aug 24 09:07:18.215033 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 619/1218] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:17 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:07:18.231042 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:18.231824 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:18.232418 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:18.233047 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lazy-loading 'fault' on Instance uuid db3a6687-812a-4169-96f5-0e7e9f3af30f {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:07:18.247331 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-92a1ab17-3ec2-47ae-8de0-7024300c5077 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:18.247967 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-92a1ab17-3ec2-47ae-8de0-7024300c5077 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:18.254444 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-92a1ab17-3ec2-47ae-8de0-7024300c5077 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:18.255244 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-92a1ab17-3ec2-47ae-8de0-7024300c5077 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:18.255859 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-92a1ab17-3ec2-47ae-8de0-7024300c5077 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:18.256782 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-92a1ab17-3ec2-47ae-8de0-7024300c5077 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:18.257691 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-92a1ab17-3ec2-47ae-8de0-7024300c5077 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:18.258313 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-92a1ab17-3ec2-47ae-8de0-7024300c5077 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:18.300950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7aee76519492e81b0048edebba36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d5c74d88a24eb9814f49a6ff4eca56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:18.321286 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fdcd5fc1-5068-4174-ae2f-36e5d8ea3e78 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 200 len: 1327 microversion: 2.1 time: 0.213128 Aug 24 09:07:18.322940 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 600/1219] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:18 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 1327 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:18.452152 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-92a1ab17-3ec2-47ae-8de0-7024300c5077 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:18.466497 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-92a1ab17-3ec2-47ae-8de0-7024300c5077 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1277 microversion: 2.1 time: 0.223307 Aug 24 09:07:18.467425 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 620/1220] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:18 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1277 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:18.565306 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-8be5c82a-617f-4de8-8f33-2bd922d36a7a req-47487125-09af-46fd-8692-fcefd747546a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fe50f9-e517-4e9a-80b5-6faba0b9f10a", "name": "network-vif-plugged", "status": "completed", "tag": "8d40ee89-fb81-4d38-99c2-3dac67fab1b0"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:07:18.576111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-8be5c82a-617f-4de8-8f33-2bd922d36a7a req-47487125-09af-46fd-8692-fcefd747546a service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:18.576729 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-8be5c82a-617f-4de8-8f33-2bd922d36a7a req-47487125-09af-46fd-8692-fcefd747546a service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:18.577191 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-8be5c82a-617f-4de8-8f33-2bd922d36a7a req-47487125-09af-46fd-8692-fcefd747546a service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:18.591686 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-8be5c82a-617f-4de8-8f33-2bd922d36a7a req-47487125-09af-46fd-8692-fcefd747546a service nova] Creating event network-vif-plugged:8d40ee89-fb81-4d38-99c2-3dac67fab1b0 for instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a on hv-cinder-85221 Aug 24 09:07:18.602821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-8be5c82a-617f-4de8-8f33-2bd922d36a7a req-47487125-09af-46fd-8692-fcefd747546a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116666 Aug 24 09:07:18.603446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 601/1221] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:07:19.105952 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-4d65259b-bbaa-479a-ae01-0ee6689524ad req-f59c0698-34d1-42c6-9ffd-6282e989975a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8827f4a3-4165-449e-99fe-732606d0bb97", "tag": "110d00be-0027-4415-be65-03f3cb848994"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:07:19.117030 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-4d65259b-bbaa-479a-ae01-0ee6689524ad req-f59c0698-34d1-42c6-9ffd-6282e989975a service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:19.117515 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-4d65259b-bbaa-479a-ae01-0ee6689524ad req-f59c0698-34d1-42c6-9ffd-6282e989975a service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:19.117951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-4d65259b-bbaa-479a-ae01-0ee6689524ad req-f59c0698-34d1-42c6-9ffd-6282e989975a service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:19.131810 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-4d65259b-bbaa-479a-ae01-0ee6689524ad req-f59c0698-34d1-42c6-9ffd-6282e989975a service nova] Creating event network-changed:110d00be-0027-4415-be65-03f3cb848994 for instance 8827f4a3-4165-449e-99fe-732606d0bb97 on hv-cinder-85221 Aug 24 09:07:19.137639 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-4d65259b-bbaa-479a-ae01-0ee6689524ad req-f59c0698-34d1-42c6-9ffd-6282e989975a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035495 Aug 24 09:07:19.138265 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 621/1222] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:07:19.242771 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b32c8d04-64a9-4c07-b360-98d29b6c8877 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:19.243485 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b32c8d04-64a9-4c07-b360-98d29b6c8877 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:19.252801 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b32c8d04-64a9-4c07-b360-98d29b6c8877 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:19.253289 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b32c8d04-64a9-4c07-b360-98d29b6c8877 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:19.253726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b32c8d04-64a9-4c07-b360-98d29b6c8877 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:19.255151 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b32c8d04-64a9-4c07-b360-98d29b6c8877 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:19.255614 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b32c8d04-64a9-4c07-b360-98d29b6c8877 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:19.256320 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b32c8d04-64a9-4c07-b360-98d29b6c8877 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:19.354395 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-60522869-292d-47ba-8e0b-1cab76e81cca tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:19.355099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-60522869-292d-47ba-8e0b-1cab76e81cca tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:19.362488 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60522869-292d-47ba-8e0b-1cab76e81cca tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:19.363357 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60522869-292d-47ba-8e0b-1cab76e81cca tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:19.364125 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60522869-292d-47ba-8e0b-1cab76e81cca tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:19.365316 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60522869-292d-47ba-8e0b-1cab76e81cca tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:19.366103 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60522869-292d-47ba-8e0b-1cab76e81cca tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:19.366918 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60522869-292d-47ba-8e0b-1cab76e81cca tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:19.391791 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-60522869-292d-47ba-8e0b-1cab76e81cca tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] HTTP exception thrown: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:19.391985 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b32c8d04-64a9-4c07-b360-98d29b6c8877 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-60522869-292d-47ba-8e0b-1cab76e81cca tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Request method failure captured: Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f HTTP/1.1 Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeQxdz4yyMwfuy4AeW2YWC8zGlOF5k8702uYch7aWwkOyrDPGq2h_tsrnxOyQwCp9Iye0ujLb8Yo-DOBeXuMxvcUK2LjZGwldFOEqm03AixiGm3Ntb--_OjdaEtHcLgGkj4wvymjjYbUueFsAkuoagUeQrOT8EQQPHolTa3NeMyGpg Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 02d5c74d88a24eb9814f49a6ff4eca56 Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:07:19.394903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:07:19.396813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_02d5c74d88a24eb9814f49a6ff4eca56", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:07:19.396813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:19.396813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 02d5c74d88a24eb9814f49a6ff4eca56 Aug 24 09:07:19.396813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:19.396813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-AttachVolumeTestJSON-1534009168-project Aug 24 09:07:19.396813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:07:19.396813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:07:19.396813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: f5d7aee76519492e81b0048edebba36f Aug 24 09:07:19.396813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-AttachVolumeTestJSON-1534009168-project Aug 24 09:07:19.396813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:07:19.396813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:19.396813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': 'db3a6687-812a-4169-96f5-0e7e9f3af30f'} Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:07:19.398175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:19.400525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:19.407448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-60522869-292d-47ba-8e0b-1cab76e81cca tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Returning 404 to user: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:07:19.407448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-60522869-292d-47ba-8e0b-1cab76e81cca tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 404 len: 111 microversion: 2.1 time: 0.047048 Aug 24 09:07:19.407448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 622/1223] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:19 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 09:07:19.407833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b32c8d04-64a9-4c07-b360-98d29b6c8877 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:19.407833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b32c8d04-64a9-4c07-b360-98d29b6c8877 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:19.407833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b32c8d04-64a9-4c07-b360-98d29b6c8877 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.168246 Aug 24 09:07:19.408159 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 602/1224] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:19 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:19.411427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7bc47aef-acd0-4239-be1e-64ca45db177f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '.version_select at 0x7f16ae3a1ca0>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:19.478623 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7bc47aef-acd0-4239-be1e-64ca45db177f tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-290502672" status: 202 len: 0 microversion: 2.1 time: 0.073489 Aug 24 09:07:19.479205 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 623/1225] 10.222.0.55 () {58 vars in 1218 bytes} [Wed Aug 24 09:07:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-290502672 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:07:19.488143 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-47f4366a-d992-4c87-aa33-aed51c298b48 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:19.488790 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-47f4366a-d992-4c87-aa33-aed51c298b48 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:19.495601 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47f4366a-d992-4c87-aa33-aed51c298b48 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:19.495994 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47f4366a-d992-4c87-aa33-aed51c298b48 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:19.496424 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47f4366a-d992-4c87-aa33-aed51c298b48 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:19.497688 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47f4366a-d992-4c87-aa33-aed51c298b48 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:19.498325 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47f4366a-d992-4c87-aa33-aed51c298b48 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:19.498766 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47f4366a-d992-4c87-aa33-aed51c298b48 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:19.649596 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-47f4366a-d992-4c87-aa33-aed51c298b48 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:19.658119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-47f4366a-d992-4c87-aa33-aed51c298b48 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.174531 Aug 24 09:07:19.658692 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 603/1226] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:19 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:20.430659 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-db56a666-cbe7-4bd3-9f0f-6d02a5b2c37b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:20.431280 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-db56a666-cbe7-4bd3-9f0f-6d02a5b2c37b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:20.438882 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db56a666-cbe7-4bd3-9f0f-6d02a5b2c37b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:20.439372 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db56a666-cbe7-4bd3-9f0f-6d02a5b2c37b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:20.439814 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db56a666-cbe7-4bd3-9f0f-6d02a5b2c37b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:20.440658 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db56a666-cbe7-4bd3-9f0f-6d02a5b2c37b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:20.441048 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db56a666-cbe7-4bd3-9f0f-6d02a5b2c37b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:20.441473 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-db56a666-cbe7-4bd3-9f0f-6d02a5b2c37b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:20.583955 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-db56a666-cbe7-4bd3-9f0f-6d02a5b2c37b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:20.593322 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-db56a666-cbe7-4bd3-9f0f-6d02a5b2c37b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:20.594862 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-db56a666-cbe7-4bd3-9f0f-6d02a5b2c37b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:20.596079 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-db56a666-cbe7-4bd3-9f0f-6d02a5b2c37b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.170101 Aug 24 09:07:20.596748 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 624/1227] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:20 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:20.680487 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3228e1ab-acd0-4cbe-9269-fa0876c47e15 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:20.681419 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3228e1ab-acd0-4cbe-9269-fa0876c47e15 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:20.689328 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3228e1ab-acd0-4cbe-9269-fa0876c47e15 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:20.689984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3228e1ab-acd0-4cbe-9269-fa0876c47e15 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:20.690522 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3228e1ab-acd0-4cbe-9269-fa0876c47e15 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:20.691614 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3228e1ab-acd0-4cbe-9269-fa0876c47e15 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:20.692235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3228e1ab-acd0-4cbe-9269-fa0876c47e15 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:20.692763 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3228e1ab-acd0-4cbe-9269-fa0876c47e15 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:20.926786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3228e1ab-acd0-4cbe-9269-fa0876c47e15 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:20.938775 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3228e1ab-acd0-4cbe-9269-fa0876c47e15 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.262278 Aug 24 09:07:20.939400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 604/1228] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:20 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:21.619178 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-cf099f4b-a86f-4dc7-b7f6-50073ae21fb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:21.619788 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-cf099f4b-a86f-4dc7-b7f6-50073ae21fb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:21.626913 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cf099f4b-a86f-4dc7-b7f6-50073ae21fb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:21.627377 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cf099f4b-a86f-4dc7-b7f6-50073ae21fb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:21.627911 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cf099f4b-a86f-4dc7-b7f6-50073ae21fb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:21.628510 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cf099f4b-a86f-4dc7-b7f6-50073ae21fb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:21.628986 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cf099f4b-a86f-4dc7-b7f6-50073ae21fb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:21.629426 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cf099f4b-a86f-4dc7-b7f6-50073ae21fb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:21.777012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-cf099f4b-a86f-4dc7-b7f6-50073ae21fb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:21.787968 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-cf099f4b-a86f-4dc7-b7f6-50073ae21fb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:21.790387 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-cf099f4b-a86f-4dc7-b7f6-50073ae21fb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:21.791759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-cf099f4b-a86f-4dc7-b7f6-50073ae21fb3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.176432 Aug 24 09:07:21.792450 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 625/1229] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:21 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:21.971507 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-97b2bb73-a03e-44c3-9272-8ff90635f721 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:21.972132 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-97b2bb73-a03e-44c3-9272-8ff90635f721 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:21.978741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-97b2bb73-a03e-44c3-9272-8ff90635f721 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:21.979236 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-97b2bb73-a03e-44c3-9272-8ff90635f721 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:21.982294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-97b2bb73-a03e-44c3-9272-8ff90635f721 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:21.982294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-97b2bb73-a03e-44c3-9272-8ff90635f721 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:21.982294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-97b2bb73-a03e-44c3-9272-8ff90635f721 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:21.982294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-97b2bb73-a03e-44c3-9272-8ff90635f721 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:22.140766 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-97b2bb73-a03e-44c3-9272-8ff90635f721 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:22.149148 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-97b2bb73-a03e-44c3-9272-8ff90635f721 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.181513 Aug 24 09:07:22.149580 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 605/1230] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:21 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:22.817706 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-014264f8-9646-41fc-8f17-9e517f85332d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:22.818300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-014264f8-9646-41fc-8f17-9e517f85332d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:22.820817 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:22.825882 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-014264f8-9646-41fc-8f17-9e517f85332d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:22.826373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-014264f8-9646-41fc-8f17-9e517f85332d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:22.826839 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-014264f8-9646-41fc-8f17-9e517f85332d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:22.828397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-014264f8-9646-41fc-8f17-9e517f85332d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:22.828695 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-014264f8-9646-41fc-8f17-9e517f85332d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:22.829044 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-014264f8-9646-41fc-8f17-9e517f85332d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:22.964095 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-014264f8-9646-41fc-8f17-9e517f85332d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:22.972690 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-014264f8-9646-41fc-8f17-9e517f85332d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:22.974381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-014264f8-9646-41fc-8f17-9e517f85332d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:22.975333 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-014264f8-9646-41fc-8f17-9e517f85332d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1731 microversion: 2.20 time: 0.161955 Aug 24 09:07:22.975891 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 626/1231] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:22 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:23.138098 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-61058d93-48e9-4c9a-9fa5-1c833e046ce5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:23.138627 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-61058d93-48e9-4c9a-9fa5-1c833e046ce5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:23.145666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-61058d93-48e9-4c9a-9fa5-1c833e046ce5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:23.146140 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-61058d93-48e9-4c9a-9fa5-1c833e046ce5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:23.146570 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-61058d93-48e9-4c9a-9fa5-1c833e046ce5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:23.147252 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-61058d93-48e9-4c9a-9fa5-1c833e046ce5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:23.147698 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-61058d93-48e9-4c9a-9fa5-1c833e046ce5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:23.148112 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-61058d93-48e9-4c9a-9fa5-1c833e046ce5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:23.162561 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-61058d93-48e9-4c9a-9fa5-1c833e046ce5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] HTTP exception thrown: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-61058d93-48e9-4c9a-9fa5-1c833e046ce5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Request method failure captured: Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: DELETE /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f HTTP/1.1 Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeQxdz4yyMwfuy4AeW2YWC8zGlOF5k8702uYch7aWwkOyrDPGq2h_tsrnxOyQwCp9Iye0ujLb8Yo-DOBeXuMxvcUK2LjZGwldFOEqm03AixiGm3Ntb--_OjdaEtHcLgGkj4wvymjjYbUueFsAkuoagUeQrOT8EQQPHolTa3NeMyGpg Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 02d5c74d88a24eb9814f49a6ff4eca56 Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:07:23.163879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:07:23.165531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_02d5c74d88a24eb9814f49a6ff4eca56", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:07:23.165531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:23.165531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 02d5c74d88a24eb9814f49a6ff4eca56 Aug 24 09:07:23.165531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:23.165531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-AttachVolumeTestJSON-1534009168-project Aug 24 09:07:23.165531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:07:23.165531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:07:23.165531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: f5d7aee76519492e81b0048edebba36f Aug 24 09:07:23.165531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-AttachVolumeTestJSON-1534009168-project Aug 24 09:07:23.165531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:07:23.165531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:23.165531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': 'db3a6687-812a-4169-96f5-0e7e9f3af30f'} Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:07:23.166464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:23.167776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:07:23.169154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-61058d93-48e9-4c9a-9fa5-1c833e046ce5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Returning 404 to user: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:07:23.169154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-61058d93-48e9-4c9a-9fa5-1c833e046ce5 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "DELETE /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 404 len: 111 microversion: 2.1 time: 0.030576 Aug 24 09:07:23.169154 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 606/1232] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:07:23 2022] DELETE /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:07:23.174124 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2ab387cb-3b2f-4226-85e5-32165e15665d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:23.174560 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-97a0a965-1926-4a5c-9527-933b432c9a66 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:23.174735 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2ab387cb-3b2f-4226-85e5-32165e15665d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:23.175169 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-97a0a965-1926-4a5c-9527-933b432c9a66 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: db3a6687-812a-4169-96f5-0e7e9f3af30f] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:23.180783 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2ab387cb-3b2f-4226-85e5-32165e15665d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:23.181261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2ab387cb-3b2f-4226-85e5-32165e15665d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:23.185214 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2ab387cb-3b2f-4226-85e5-32165e15665d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:23.185214 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2ab387cb-3b2f-4226-85e5-32165e15665d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:23.185214 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2ab387cb-3b2f-4226-85e5-32165e15665d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:23.185518 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97a0a965-1926-4a5c-9527-933b432c9a66 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:23.185624 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2ab387cb-3b2f-4226-85e5-32165e15665d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:23.185720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97a0a965-1926-4a5c-9527-933b432c9a66 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:23.185720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97a0a965-1926-4a5c-9527-933b432c9a66 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:23.185720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97a0a965-1926-4a5c-9527-933b432c9a66 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:23.185720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97a0a965-1926-4a5c-9527-933b432c9a66 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:23.186063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97a0a965-1926-4a5c-9527-933b432c9a66 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-97a0a965-1926-4a5c-9527-933b432c9a66 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] HTTP exception thrown: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-97a0a965-1926-4a5c-9527-933b432c9a66 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Request method failure captured: Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f HTTP/1.1 Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeQxdz4yyMwfuy4AeW2YWC8zGlOF5k8702uYch7aWwkOyrDPGq2h_tsrnxOyQwCp9Iye0ujLb8Yo-DOBeXuMxvcUK2LjZGwldFOEqm03AixiGm3Ntb--_OjdaEtHcLgGkj4wvymjjYbUueFsAkuoagUeQrOT8EQQPHolTa3NeMyGpg Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 02d5c74d88a24eb9814f49a6ff4eca56 Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:07:23.204697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:07:23.206215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_02d5c74d88a24eb9814f49a6ff4eca56", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:07:23.206215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:23.206215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 02d5c74d88a24eb9814f49a6ff4eca56 Aug 24 09:07:23.206215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:23.206215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-AttachVolumeTestJSON-1534009168-project Aug 24 09:07:23.206215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:07:23.206215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:07:23.206215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: f5d7aee76519492e81b0048edebba36f Aug 24 09:07:23.206215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-AttachVolumeTestJSON-1534009168-project Aug 24 09:07:23.206215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:07:23.206215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:23.206215 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': 'db3a6687-812a-4169-96f5-0e7e9f3af30f'} Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:07:23.206993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. Aug 24 09:07:23.208294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:23.209472 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-97a0a965-1926-4a5c-9527-933b432c9a66 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Returning 404 to user: Instance db3a6687-812a-4169-96f5-0e7e9f3af30f could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:07:23.209472 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-97a0a965-1926-4a5c-9527-933b432c9a66 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f" status: 404 len: 111 microversion: 2.1 time: 0.034644 Aug 24 09:07:23.209472 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 627/1233] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:23 2022] GET /compute/v2.1/servers/db3a6687-812a-4169-96f5-0e7e9f3af30f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:07:23.327743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2ab387cb-3b2f-4226-85e5-32165e15665d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:23.335791 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2ab387cb-3b2f-4226-85e5-32165e15665d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.165298 Aug 24 09:07:23.336356 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 607/1234] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:23 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:23.998641 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0692e13f-f07f-4e1f-95b8-5560d510e3f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:23.999294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0692e13f-f07f-4e1f-95b8-5560d510e3f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:24.006246 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0692e13f-f07f-4e1f-95b8-5560d510e3f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:24.006704 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0692e13f-f07f-4e1f-95b8-5560d510e3f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:24.007112 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0692e13f-f07f-4e1f-95b8-5560d510e3f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:24.007789 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0692e13f-f07f-4e1f-95b8-5560d510e3f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:24.008228 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0692e13f-f07f-4e1f-95b8-5560d510e3f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:24.008674 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0692e13f-f07f-4e1f-95b8-5560d510e3f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:24.141817 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0692e13f-f07f-4e1f-95b8-5560d510e3f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:24.150315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0692e13f-f07f-4e1f-95b8-5560d510e3f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:24.151941 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0692e13f-f07f-4e1f-95b8-5560d510e3f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:24.153180 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0692e13f-f07f-4e1f-95b8-5560d510e3f1 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1718 microversion: 2.20 time: 0.158611 Aug 24 09:07:24.153733 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 628/1235] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:07:23 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:07:24.356498 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fb976a5f-085a-4f55-854e-a483f9d57757 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:24.357120 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-fb976a5f-085a-4f55-854e-a483f9d57757 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:24.363506 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fb976a5f-085a-4f55-854e-a483f9d57757 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:24.363977 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fb976a5f-085a-4f55-854e-a483f9d57757 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:24.364403 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fb976a5f-085a-4f55-854e-a483f9d57757 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:24.365110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fb976a5f-085a-4f55-854e-a483f9d57757 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:24.365554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fb976a5f-085a-4f55-854e-a483f9d57757 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:24.365969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fb976a5f-085a-4f55-854e-a483f9d57757 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:24.434408 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d3ac27a5-a8a5-4354-af54-06e8033d4458 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:24.435081 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d3ac27a5-a8a5-4354-af54-06e8033d4458 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:24.441711 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d3ac27a5-a8a5-4354-af54-06e8033d4458 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:24.442226 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d3ac27a5-a8a5-4354-af54-06e8033d4458 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:24.442657 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d3ac27a5-a8a5-4354-af54-06e8033d4458 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:24.443387 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d3ac27a5-a8a5-4354-af54-06e8033d4458 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:24.443787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d3ac27a5-a8a5-4354-af54-06e8033d4458 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:24.444207 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d3ac27a5-a8a5-4354-af54-06e8033d4458 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:24.459130 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-d3ac27a5-a8a5-4354-af54-06e8033d4458 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] HTTP exception thrown: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d3ac27a5-a8a5-4354-af54-06e8033d4458 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Request method failure captured: Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: DELETE /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 HTTP/1.1 Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeQxdz4yyMwfuy4AeW2YWC8zGlOF5k8702uYch7aWwkOyrDPGq2h_tsrnxOyQwCp9Iye0ujLb8Yo-DOBeXuMxvcUK2LjZGwldFOEqm03AixiGm3Ntb--_OjdaEtHcLgGkj4wvymjjYbUueFsAkuoagUeQrOT8EQQPHolTa3NeMyGpg Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 02d5c74d88a24eb9814f49a6ff4eca56 Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:07:24.460750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:07:24.462485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_02d5c74d88a24eb9814f49a6ff4eca56", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:07:24.462485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:24.462485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 02d5c74d88a24eb9814f49a6ff4eca56 Aug 24 09:07:24.462485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:24.462485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-AttachVolumeTestJSON-1534009168-project Aug 24 09:07:24.462485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:07:24.462485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:07:24.462485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: f5d7aee76519492e81b0048edebba36f Aug 24 09:07:24.462485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-AttachVolumeTestJSON-1534009168-project Aug 24 09:07:24.462485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:07:24.462485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:07:24.462485 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '9a46236b-ed03-4f8e-8eba-3d04a06056a1'} Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:07:24.463508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:07:24.465084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:24.466592 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d3ac27a5-a8a5-4354-af54-06e8033d4458 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Returning 404 to user: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:07:24.466592 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d3ac27a5-a8a5-4354-af54-06e8033d4458 tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 404 len: 111 microversion: 2.1 time: 0.032055 Aug 24 09:07:24.466592 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 629/1236] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:07:24 2022] DELETE /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:07:24.475237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8ba90df5-b6ab-4c11-b567-dee42fd3e03d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:24.475902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-8ba90df5-b6ab-4c11-b567-dee42fd3e03d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] [instance: 9a46236b-ed03-4f8e-8eba-3d04a06056a1] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:24.481747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ba90df5-b6ab-4c11-b567-dee42fd3e03d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:24.482491 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ba90df5-b6ab-4c11-b567-dee42fd3e03d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:24.482671 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ba90df5-b6ab-4c11-b567-dee42fd3e03d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:24.483398 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ba90df5-b6ab-4c11-b567-dee42fd3e03d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:24.483845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ba90df5-b6ab-4c11-b567-dee42fd3e03d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:24.484268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-8ba90df5-b6ab-4c11-b567-dee42fd3e03d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:24.499451 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fb976a5f-085a-4f55-854e-a483f9d57757 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:24.499722 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-8ba90df5-b6ab-4c11-b567-dee42fd3e03d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] HTTP exception thrown: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8ba90df5-b6ab-4c11-b567-dee42fd3e03d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Request method failure captured: Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 HTTP/1.1 Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeQxdz4yyMwfuy4AeW2YWC8zGlOF5k8702uYch7aWwkOyrDPGq2h_tsrnxOyQwCp9Iye0ujLb8Yo-DOBeXuMxvcUK2LjZGwldFOEqm03AixiGm3Ntb--_OjdaEtHcLgGkj4wvymjjYbUueFsAkuoagUeQrOT8EQQPHolTa3NeMyGpg Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 02d5c74d88a24eb9814f49a6ff4eca56 Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:07:24.501281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:07:24.502937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_02d5c74d88a24eb9814f49a6ff4eca56", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02d5c74d88a24eb9814f49a6ff4eca56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:07:24.502937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:24.502937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 02d5c74d88a24eb9814f49a6ff4eca56 Aug 24 09:07:24.502937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1534009168 Aug 24 09:07:24.502937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-AttachVolumeTestJSON-1534009168-project Aug 24 09:07:24.502937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:07:24.502937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:07:24.502937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: f5d7aee76519492e81b0048edebba36f Aug 24 09:07:24.502937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-AttachVolumeTestJSON-1534009168-project Aug 24 09:07:24.502937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:07:24.502937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:07:24.502937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '9a46236b-ed03-4f8e-8eba-3d04a06056a1'} Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:07:24.503916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. Aug 24 09:07:24.505452 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:07:24.506837 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8ba90df5-b6ab-4c11-b567-dee42fd3e03d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] Returning 404 to user: Instance 9a46236b-ed03-4f8e-8eba-3d04a06056a1 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:07:24.506837 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8ba90df5-b6ab-4c11-b567-dee42fd3e03d tempest-AttachVolumeTestJSON-1534009168 tempest-AttachVolumeTestJSON-1534009168-project] 10.222.0.55 "GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1" status: 404 len: 111 microversion: 2.1 time: 0.031267 Aug 24 09:07:24.506837 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 630/1237] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:24 2022] GET /compute/v2.1/servers/9a46236b-ed03-4f8e-8eba-3d04a06056a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 09:07:24.509369 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:24.512232 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fb976a5f-085a-4f55-854e-a483f9d57757 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.159457 Aug 24 09:07:24.513065 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 608/1238] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:24 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:25.536226 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0bc98ea8-9550-4b7a-8e92-06761b6b9cee tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:25.536932 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0bc98ea8-9550-4b7a-8e92-06761b6b9cee tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:25.543776 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0bc98ea8-9550-4b7a-8e92-06761b6b9cee tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:25.544620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0bc98ea8-9550-4b7a-8e92-06761b6b9cee tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:25.545066 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0bc98ea8-9550-4b7a-8e92-06761b6b9cee tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:25.545763 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0bc98ea8-9550-4b7a-8e92-06761b6b9cee tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:25.546854 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0bc98ea8-9550-4b7a-8e92-06761b6b9cee tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:25.547276 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0bc98ea8-9550-4b7a-8e92-06761b6b9cee tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:25.760797 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0bc98ea8-9550-4b7a-8e92-06761b6b9cee tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:25.769531 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0bc98ea8-9550-4b7a-8e92-06761b6b9cee tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.238233 Aug 24 09:07:25.770036 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 631/1239] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:25 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:26.792260 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-06a96104-21e2-4641-a2d8-3d78cbb82800 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:26.796739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-06a96104-21e2-4641-a2d8-3d78cbb82800 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:26.797847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=82 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:26.803591 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-06a96104-21e2-4641-a2d8-3d78cbb82800 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:26.804081 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-06a96104-21e2-4641-a2d8-3d78cbb82800 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:26.804807 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-06a96104-21e2-4641-a2d8-3d78cbb82800 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:26.806029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-06a96104-21e2-4641-a2d8-3d78cbb82800 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:26.806697 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-06a96104-21e2-4641-a2d8-3d78cbb82800 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:26.807132 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-06a96104-21e2-4641-a2d8-3d78cbb82800 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:26.970647 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-06a96104-21e2-4641-a2d8-3d78cbb82800 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:26.978974 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-06a96104-21e2-4641-a2d8-3d78cbb82800 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.191084 Aug 24 09:07:26.979544 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 609/1240] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:26 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:28.008077 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f7dcf1c4-528c-4ccb-939e-1ba8af908d31 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:28.013615 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f7dcf1c4-528c-4ccb-939e-1ba8af908d31 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:28.020128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f7dcf1c4-528c-4ccb-939e-1ba8af908d31 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:28.020932 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f7dcf1c4-528c-4ccb-939e-1ba8af908d31 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:28.021747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f7dcf1c4-528c-4ccb-939e-1ba8af908d31 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:28.023117 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f7dcf1c4-528c-4ccb-939e-1ba8af908d31 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:28.023692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f7dcf1c4-528c-4ccb-939e-1ba8af908d31 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:28.024355 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f7dcf1c4-528c-4ccb-939e-1ba8af908d31 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:28.319311 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f7dcf1c4-528c-4ccb-939e-1ba8af908d31 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:28.336285 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f7dcf1c4-528c-4ccb-939e-1ba8af908d31 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.337391 Aug 24 09:07:28.345898 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 632/1241] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:27 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:29.358170 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7d93a16b-8b6c-4907-82a0-701d6aa7274e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:29.358843 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-7d93a16b-8b6c-4907-82a0-701d6aa7274e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:29.368632 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7d93a16b-8b6c-4907-82a0-701d6aa7274e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:29.369448 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7d93a16b-8b6c-4907-82a0-701d6aa7274e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:29.370240 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7d93a16b-8b6c-4907-82a0-701d6aa7274e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:29.370988 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7d93a16b-8b6c-4907-82a0-701d6aa7274e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:29.371452 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7d93a16b-8b6c-4907-82a0-701d6aa7274e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:29.371884 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7d93a16b-8b6c-4907-82a0-701d6aa7274e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:29.533758 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7d93a16b-8b6c-4907-82a0-701d6aa7274e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:29.542032 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7d93a16b-8b6c-4907-82a0-701d6aa7274e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.188196 Aug 24 09:07:29.542607 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 610/1242] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:29 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:30.574858 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-cb94e74e-497f-4e1e-9fc9-ef8b07484b22 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:30.575585 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-cb94e74e-497f-4e1e-9fc9-ef8b07484b22 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:30.582074 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cb94e74e-497f-4e1e-9fc9-ef8b07484b22 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:30.582553 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cb94e74e-497f-4e1e-9fc9-ef8b07484b22 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:30.582987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cb94e74e-497f-4e1e-9fc9-ef8b07484b22 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:30.583689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cb94e74e-497f-4e1e-9fc9-ef8b07484b22 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:30.584138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cb94e74e-497f-4e1e-9fc9-ef8b07484b22 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:30.584583 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cb94e74e-497f-4e1e-9fc9-ef8b07484b22 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:30.722553 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-cb94e74e-497f-4e1e-9fc9-ef8b07484b22 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:30.731678 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-cb94e74e-497f-4e1e-9fc9-ef8b07484b22 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.160514 Aug 24 09:07:30.732417 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 633/1243] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:30 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:31.765956 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6a8a2686-ca59-496e-80ef-f9bb8af0da9e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:31.766495 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6a8a2686-ca59-496e-80ef-f9bb8af0da9e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:31.773035 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6a8a2686-ca59-496e-80ef-f9bb8af0da9e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:31.773514 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6a8a2686-ca59-496e-80ef-f9bb8af0da9e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:31.773942 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6a8a2686-ca59-496e-80ef-f9bb8af0da9e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:31.774645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6a8a2686-ca59-496e-80ef-f9bb8af0da9e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:31.775089 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6a8a2686-ca59-496e-80ef-f9bb8af0da9e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:31.775500 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6a8a2686-ca59-496e-80ef-f9bb8af0da9e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:31.918615 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6a8a2686-ca59-496e-80ef-f9bb8af0da9e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:31.926867 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6a8a2686-ca59-496e-80ef-f9bb8af0da9e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.164945 Aug 24 09:07:31.927443 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 611/1244] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:31 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:32.412109 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-6ef189e0-0bb2-47ed-8fe5-67c36d638f17 req-cf165b48-c494-4a99-8310-668e2f09593c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8827f4a3-4165-449e-99fe-732606d0bb97", "name": "network-vif-plugged", "status": "completed", "tag": "110d00be-0027-4415-be65-03f3cb848994"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:07:32.422171 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-6ef189e0-0bb2-47ed-8fe5-67c36d638f17 req-cf165b48-c494-4a99-8310-668e2f09593c service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:32.423092 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-6ef189e0-0bb2-47ed-8fe5-67c36d638f17 req-cf165b48-c494-4a99-8310-668e2f09593c service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:32.423092 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-6ef189e0-0bb2-47ed-8fe5-67c36d638f17 req-cf165b48-c494-4a99-8310-668e2f09593c service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:32.434098 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-6ef189e0-0bb2-47ed-8fe5-67c36d638f17 req-cf165b48-c494-4a99-8310-668e2f09593c service nova] Creating event network-vif-plugged:110d00be-0027-4415-be65-03f3cb848994 for instance 8827f4a3-4165-449e-99fe-732606d0bb97 on hv-cinder-85221 Aug 24 09:07:32.439061 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-6ef189e0-0bb2-47ed-8fe5-67c36d638f17 req-cf165b48-c494-4a99-8310-668e2f09593c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031171 Aug 24 09:07:32.439638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 634/1245] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:07:32.949689 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4bd2fda8-3c9e-4d98-b220-c01627b4cf84 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:32.950354 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4bd2fda8-3c9e-4d98-b220-c01627b4cf84 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:32.957975 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4bd2fda8-3c9e-4d98-b220-c01627b4cf84 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:32.958456 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4bd2fda8-3c9e-4d98-b220-c01627b4cf84 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:32.958880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4bd2fda8-3c9e-4d98-b220-c01627b4cf84 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:32.959567 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4bd2fda8-3c9e-4d98-b220-c01627b4cf84 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:32.960008 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4bd2fda8-3c9e-4d98-b220-c01627b4cf84 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:32.960421 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4bd2fda8-3c9e-4d98-b220-c01627b4cf84 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:33.137151 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4bd2fda8-3c9e-4d98-b220-c01627b4cf84 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:33.145594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4bd2fda8-3c9e-4d98-b220-c01627b4cf84 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.200454 Aug 24 09:07:33.146429 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 612/1246] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:32 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:33.409029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-244fe148-b293-46fe-88bc-d16ebe661b7a tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] Calling method '.version_select at 0x7f16b2c26040>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:33.457251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-244fe148-b293-46fe-88bc-d16ebe661b7a tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/96300395-4ac9-4ecc-b10a-448fde5e6ed2" status: 200 len: 350 microversion: 2.1 time: 0.052552 Aug 24 09:07:33.457849 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 635/1247] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 09:07:33 2022] GET /compute/v2.1/os-volumes/96300395-4ac9-4ecc-b10a-448fde5e6ed2 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:07:34.166619 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-eea5e3cb-4cb7-4794-8b21-5566066b46a1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:34.167302 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-eea5e3cb-4cb7-4794-8b21-5566066b46a1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:34.174191 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-eea5e3cb-4cb7-4794-8b21-5566066b46a1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:34.174602 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-eea5e3cb-4cb7-4794-8b21-5566066b46a1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:34.175030 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-eea5e3cb-4cb7-4794-8b21-5566066b46a1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:34.175717 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-eea5e3cb-4cb7-4794-8b21-5566066b46a1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:34.176196 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-eea5e3cb-4cb7-4794-8b21-5566066b46a1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:34.176647 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-eea5e3cb-4cb7-4794-8b21-5566066b46a1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:34.324450 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-eea5e3cb-4cb7-4794-8b21-5566066b46a1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:34.333180 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-eea5e3cb-4cb7-4794-8b21-5566066b46a1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.170503 Aug 24 09:07:34.333762 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 613/1248] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:34 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:35.354705 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c9ef8d37-abab-4db9-b56b-31203b656953 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:35.355388 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c9ef8d37-abab-4db9-b56b-31203b656953 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:35.364006 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c9ef8d37-abab-4db9-b56b-31203b656953 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:35.364490 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c9ef8d37-abab-4db9-b56b-31203b656953 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:35.364956 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c9ef8d37-abab-4db9-b56b-31203b656953 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:35.365699 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c9ef8d37-abab-4db9-b56b-31203b656953 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:35.366151 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c9ef8d37-abab-4db9-b56b-31203b656953 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:35.366580 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c9ef8d37-abab-4db9-b56b-31203b656953 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:35.504971 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c9ef8d37-abab-4db9-b56b-31203b656953 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:35.519027 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c9ef8d37-abab-4db9-b56b-31203b656953 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1265 microversion: 2.1 time: 0.168400 Aug 24 09:07:35.520084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 636/1249] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:35 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:36.262903 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f2dd6bec-ae50-4bac-b38d-619cbf13c137 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] Calling method '.version_select at 0x7f16ae419f70>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:36.310188 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f2dd6bec-ae50-4bac-b38d-619cbf13c137 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d91ab53d-fcd1-4b3e-815e-d5401585915f" status: 200 len: 349 microversion: 2.1 time: 0.050937 Aug 24 09:07:36.310772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 614/1250] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 09:07:36 2022] GET /compute/v2.1/os-volumes/d91ab53d-fcd1-4b3e-815e-d5401585915f => generated 349 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:07:36.552508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-949907c6-6735-48a7-9d33-ab79008be3e1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:36.553082 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-949907c6-6735-48a7-9d33-ab79008be3e1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:36.559511 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-949907c6-6735-48a7-9d33-ab79008be3e1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:36.559988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-949907c6-6735-48a7-9d33-ab79008be3e1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:36.561020 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-949907c6-6735-48a7-9d33-ab79008be3e1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:36.561185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-949907c6-6735-48a7-9d33-ab79008be3e1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:36.562214 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-949907c6-6735-48a7-9d33-ab79008be3e1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:36.562638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-949907c6-6735-48a7-9d33-ab79008be3e1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:36.697067 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-949907c6-6735-48a7-9d33-ab79008be3e1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:36.705779 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-949907c6-6735-48a7-9d33-ab79008be3e1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1452 microversion: 2.1 time: 0.157274 Aug 24 09:07:36.707389 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 637/1251] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:36 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:36.726508 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-551aa3bc-dcb1-4e6a-9f69-624189b06578 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:36.730538 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-551aa3bc-dcb1-4e6a-9f69-624189b06578 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:36.733140 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-551aa3bc-dcb1-4e6a-9f69-624189b06578 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:36.734269 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-551aa3bc-dcb1-4e6a-9f69-624189b06578 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:36.734698 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-551aa3bc-dcb1-4e6a-9f69-624189b06578 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:36.735381 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-551aa3bc-dcb1-4e6a-9f69-624189b06578 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:36.735823 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-551aa3bc-dcb1-4e6a-9f69-624189b06578 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:36.736244 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-551aa3bc-dcb1-4e6a-9f69-624189b06578 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:36.879171 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-551aa3bc-dcb1-4e6a-9f69-624189b06578 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:36.887424 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-551aa3bc-dcb1-4e6a-9f69-624189b06578 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1452 microversion: 2.1 time: 0.164680 Aug 24 09:07:36.891184 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 615/1252] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:36 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:39.008337 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-74e2477a-386d-4809-8e2c-2f004207ad20 req-62ca5de5-c510-4f73-a700-6d3bfff7dda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8827f4a3-4165-449e-99fe-732606d0bb97", "tag": "110d00be-0027-4415-be65-03f3cb848994"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:07:39.020008 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-74e2477a-386d-4809-8e2c-2f004207ad20 req-62ca5de5-c510-4f73-a700-6d3bfff7dda5 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:39.020716 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-74e2477a-386d-4809-8e2c-2f004207ad20 req-62ca5de5-c510-4f73-a700-6d3bfff7dda5 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:39.021336 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-74e2477a-386d-4809-8e2c-2f004207ad20 req-62ca5de5-c510-4f73-a700-6d3bfff7dda5 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:39.033676 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:39.036186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-74e2477a-386d-4809-8e2c-2f004207ad20 req-62ca5de5-c510-4f73-a700-6d3bfff7dda5 service nova] Creating event network-changed:110d00be-0027-4415-be65-03f3cb848994 for instance 8827f4a3-4165-449e-99fe-732606d0bb97 on hv-cinder-85221 Aug 24 09:07:39.043436 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-74e2477a-386d-4809-8e2c-2f004207ad20 req-62ca5de5-c510-4f73-a700-6d3bfff7dda5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039355 Aug 24 09:07:39.044058 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 638/1253] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:07:39.053896 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fb7cebb0-9dea-4ba8-b84a-d9170a044c34 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] Calling method '.version_select at 0x7f16ae4d9b80>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:39.099445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fb7cebb0-9dea-4ba8-b84a-d9170a044c34 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d7740d02-9541-4ec2-bf10-b0e90a778935" status: 200 len: 350 microversion: 2.1 time: 0.054280 Aug 24 09:07:39.100042 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 616/1254] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 09:07:39 2022] GET /compute/v2.1/os-volumes/d7740d02-9541-4ec2-bf10-b0e90a778935 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:07:39.113641 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5891d664-5846-4e17-b539-527033cde089 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] Calling method '.version_select at 0x7f16ae6283a0>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:39.208133 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5891d664-5846-4e17-b539-527033cde089 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.098898 Aug 24 09:07:39.219261 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 639/1255] 10.222.0.55 () {58 vars in 1134 bytes} [Wed Aug 24 09:07:39 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:39.226173 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5b822357-ab6d-45c1-a3b8-b797d724568c tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] Calling method '.version_select at 0x7f16ae475ca0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:39.325228 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5b822357-ab6d-45c1-a3b8-b797d724568c tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.095339 Aug 24 09:07:39.325228 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 617/1256] 10.222.0.55 () {58 vars in 1149 bytes} [Wed Aug 24 09:07:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:07:39.334680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-618580d8-0669-494d-a603-71fcbafa5a20 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] Calling method '.version_select at 0x7f16ae732a60>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:39.425252 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-618580d8-0669-494d-a603-71fcbafa5a20 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.094023 Aug 24 09:07:39.425252 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 640/1257] 10.222.0.55 () {58 vars in 1134 bytes} [Wed Aug 24 09:07:39 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:39.437730 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3b64c1f2-c3a3-4e85-a242-f6a165c51818 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] Calling method '.version_select at 0x7f16ae4199d0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:39.536032 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3b64c1f2-c3a3-4e85-a242-f6a165c51818 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.102984 Aug 24 09:07:39.536628 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 618/1258] 10.222.0.55 () {58 vars in 1167 bytes} [Wed Aug 24 09:07:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:07:39.551494 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a12647b9-b60b-40f7-8002-9d0d0f37b7c7 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] Calling method '.version_select at 0x7f16ae3a1af0>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:39.648902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a12647b9-b60b-40f7-8002-9d0d0f37b7c7 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.101618 Aug 24 09:07:39.650312 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 641/1259] 10.222.0.55 () {58 vars in 1170 bytes} [Wed Aug 24 09:07:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:07:39.663912 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e5a8cea2-9f69-487e-8bbc-aa94d59da163 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] Calling method '.version_select at 0x7f16ae34d3a0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:39.750230 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e5a8cea2-9f69-487e-8bbc-aa94d59da163 tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.090728 Aug 24 09:07:39.751028 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 619/1260] 10.222.0.55 () {58 vars in 1155 bytes} [Wed Aug 24 09:07:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:39.764418 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-8af55202-b697-4fcd-bede-e29da957706c tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] Calling method '.version_select at 0x7f16ae732940>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:39.851645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-8af55202-b697-4fcd-bede-e29da957706c tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.091166 Aug 24 09:07:39.852390 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 642/1261] 10.222.0.55 () {58 vars in 1188 bytes} [Wed Aug 24 09:07:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:07:39.867209 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7aa3af37-0d05-4571-9382-919594e97e1f tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] Calling method '.version_select at 0x7f16ae475280>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:39.956216 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7aa3af37-0d05-4571-9382-919594e97e1f tempest-VolumesTestJSON-1423901069 tempest-VolumesTestJSON-1423901069-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.093202 Aug 24 09:07:39.956870 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 620/1262] 10.222.0.55 () {58 vars in 1155 bytes} [Wed Aug 24 09:07:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:11.421460 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=23 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:11.422218 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:11.426132 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-11dbad30-7e22-4276-a88c-295d8c7f3707 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:11.426746 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-11dbad30-7e22-4276-a88c-295d8c7f3707 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:11.432848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11dbad30-7e22-4276-a88c-295d8c7f3707 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:11.433322 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11dbad30-7e22-4276-a88c-295d8c7f3707 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:11.433772 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11dbad30-7e22-4276-a88c-295d8c7f3707 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:11.434496 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11dbad30-7e22-4276-a88c-295d8c7f3707 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:11.434944 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11dbad30-7e22-4276-a88c-295d8c7f3707 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:11.435373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-11dbad30-7e22-4276-a88c-295d8c7f3707 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:11.462278 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-11dbad30-7e22-4276-a88c-295d8c7f3707 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/ips" status: 200 len: 148 microversion: 2.1 time: 0.042437 Aug 24 09:08:11.462906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 643/1263] 10.222.0.55 () {58 vars in 1248 bytes} [Wed Aug 24 09:08:11 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:14.296267 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=11 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:14.297235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=36 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:14.301402 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d554b7d4-576c-4667-8165-e527f25b579a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf32eb3c-4760-4915-aff9-eacf4c630f90"}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:08:14.304293 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d554b7d4-576c-4667-8165-e527f25b579a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:14.311059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d554b7d4-576c-4667-8165-e527f25b579a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:14.311545 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d554b7d4-576c-4667-8165-e527f25b579a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:14.312015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d554b7d4-576c-4667-8165-e527f25b579a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:14.312738 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d554b7d4-576c-4667-8165-e527f25b579a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:14.313307 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d554b7d4-576c-4667-8165-e527f25b579a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:14.313743 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d554b7d4-576c-4667-8165-e527f25b579a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:14.945458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d554b7d4-576c-4667-8165-e527f25b579a tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "POST /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.649770 Aug 24 09:08:14.946470 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 621/1264] 10.222.0.55 () {60 vars in 1323 bytes} [Wed Aug 24 09:08:14 2022] POST /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/os-volume_attachments => generated 194 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:28.925767 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-24f5e19b-1cad-4625-a604-3c7aef79d45b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:28.926365 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-24f5e19b-1cad-4625-a604-3c7aef79d45b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:28.933556 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-24f5e19b-1cad-4625-a604-3c7aef79d45b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:28.934035 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-24f5e19b-1cad-4625-a604-3c7aef79d45b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:28.934470 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-24f5e19b-1cad-4625-a604-3c7aef79d45b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:28.935166 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-24f5e19b-1cad-4625-a604-3c7aef79d45b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:28.935617 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-24f5e19b-1cad-4625-a604-3c7aef79d45b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:28.936040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-24f5e19b-1cad-4625-a604-3c7aef79d45b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:29.017065 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-24f5e19b-1cad-4625-a604-3c7aef79d45b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lazy-loading 'services' on Instance uuid 84e67a94-aad9-497d-90e2-da6f14343cf8 {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:08:29.293437 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-24f5e19b-1cad-4625-a604-3c7aef79d45b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/os-volume_attachments/cf32eb3c-4760-4915-aff9-eacf4c630f90" status: 202 len: 0 microversion: 2.1 time: 0.371265 Aug 24 09:08:29.293961 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 644/1265] 10.222.0.55 () {58 vars in 1416 bytes} [Wed Aug 24 09:08:28 2022] DELETE /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/os-volume_attachments/cf32eb3c-4760-4915-aff9-eacf4c630f90 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:08:29.300505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:29.301291 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:29.305652 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0a0f1498-2d5b-4b83-bd1c-284617bc891c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:29.307908 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0a0f1498-2d5b-4b83-bd1c-284617bc891c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:29.313929 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0a0f1498-2d5b-4b83-bd1c-284617bc891c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:29.314400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0a0f1498-2d5b-4b83-bd1c-284617bc891c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:29.314826 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0a0f1498-2d5b-4b83-bd1c-284617bc891c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:29.315510 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0a0f1498-2d5b-4b83-bd1c-284617bc891c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:29.315966 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0a0f1498-2d5b-4b83-bd1c-284617bc891c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:29.316361 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0a0f1498-2d5b-4b83-bd1c-284617bc891c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:29.350734 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0a0f1498-2d5b-4b83-bd1c-284617bc891c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051570 Aug 24 09:08:29.351301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 622/1266] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:08:29 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:30.363681 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-79d00417-a1ac-463c-afa2-994bf9bea23b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:30.366498 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-79d00417-a1ac-463c-afa2-994bf9bea23b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:30.372936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-79d00417-a1ac-463c-afa2-994bf9bea23b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:30.373418 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-79d00417-a1ac-463c-afa2-994bf9bea23b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:30.373855 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-79d00417-a1ac-463c-afa2-994bf9bea23b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:30.374550 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-79d00417-a1ac-463c-afa2-994bf9bea23b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:30.374995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-79d00417-a1ac-463c-afa2-994bf9bea23b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:30.375413 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-79d00417-a1ac-463c-afa2-994bf9bea23b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:30.407923 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-79d00417-a1ac-463c-afa2-994bf9bea23b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048973 Aug 24 09:08:30.408413 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 645/1267] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:08:30 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:31.421901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a68dc09c-a641-437d-829a-8fdc9dd0267d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:31.424112 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a68dc09c-a641-437d-829a-8fdc9dd0267d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:31.431398 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a68dc09c-a641-437d-829a-8fdc9dd0267d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:31.431863 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a68dc09c-a641-437d-829a-8fdc9dd0267d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:31.432291 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a68dc09c-a641-437d-829a-8fdc9dd0267d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:31.433001 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a68dc09c-a641-437d-829a-8fdc9dd0267d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:31.433439 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a68dc09c-a641-437d-829a-8fdc9dd0267d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:31.437808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a68dc09c-a641-437d-829a-8fdc9dd0267d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:31.463979 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a68dc09c-a641-437d-829a-8fdc9dd0267d tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047274 Aug 24 09:08:31.464532 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 623/1268] 10.222.0.55 () {58 vars in 1302 bytes} [Wed Aug 24 09:08:31 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:08:31.528222 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-939e94b5-6132-4a65-9602-50f316521fd7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:31.528814 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-939e94b5-6132-4a65-9602-50f316521fd7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:31.535174 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-939e94b5-6132-4a65-9602-50f316521fd7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:31.535906 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-939e94b5-6132-4a65-9602-50f316521fd7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:31.536336 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-939e94b5-6132-4a65-9602-50f316521fd7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:31.537054 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-939e94b5-6132-4a65-9602-50f316521fd7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:31.537561 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-939e94b5-6132-4a65-9602-50f316521fd7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:31.538057 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-939e94b5-6132-4a65-9602-50f316521fd7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:31.565289 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-939e94b5-6132-4a65-9602-50f316521fd7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Going to try to terminate instance {{(pid=132984) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:08:31.859451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-939e94b5-6132-4a65-9602-50f316521fd7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 204 len: 0 microversion: 2.1 time: 0.334807 Aug 24 09:08:31.860047 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 646/1269] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:08:31 2022] DELETE /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:08:31.869076 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-fdb4b529-b8e4-4731-8eb7-b2f28a76d31b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:31.870311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-fdb4b529-b8e4-4731-8eb7-b2f28a76d31b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:31.876021 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdb4b529-b8e4-4731-8eb7-b2f28a76d31b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:31.876499 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdb4b529-b8e4-4731-8eb7-b2f28a76d31b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:31.876988 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdb4b529-b8e4-4731-8eb7-b2f28a76d31b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:31.877685 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdb4b529-b8e4-4731-8eb7-b2f28a76d31b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:31.878215 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdb4b529-b8e4-4731-8eb7-b2f28a76d31b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:31.878636 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-fdb4b529-b8e4-4731-8eb7-b2f28a76d31b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:32.012196 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-fdb4b529-b8e4-4731-8eb7-b2f28a76d31b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:32.020268 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-fdb4b529-b8e4-4731-8eb7-b2f28a76d31b tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1680 microversion: 2.1 time: 0.155961 Aug 24 09:08:32.020872 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 624/1270] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:31 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:33.042759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-cd8ec83e-af6d-4b75-8879-90c11880a969 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:33.043612 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-cd8ec83e-af6d-4b75-8879-90c11880a969 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:33.051327 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd8ec83e-af6d-4b75-8879-90c11880a969 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:33.052260 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd8ec83e-af6d-4b75-8879-90c11880a969 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:33.052260 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd8ec83e-af6d-4b75-8879-90c11880a969 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:33.052501 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd8ec83e-af6d-4b75-8879-90c11880a969 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:33.052968 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd8ec83e-af6d-4b75-8879-90c11880a969 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:33.053473 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cd8ec83e-af6d-4b75-8879-90c11880a969 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:33.188747 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-cd8ec83e-af6d-4b75-8879-90c11880a969 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:33.197228 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-cd8ec83e-af6d-4b75-8879-90c11880a969 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1680 microversion: 2.1 time: 0.158843 Aug 24 09:08:33.197850 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 647/1271] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:33 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:34.219970 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b35a95b7-8eb8-4943-91fc-8cacaa62cc5c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:34.220604 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b35a95b7-8eb8-4943-91fc-8cacaa62cc5c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:34.227857 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b35a95b7-8eb8-4943-91fc-8cacaa62cc5c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:34.228338 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b35a95b7-8eb8-4943-91fc-8cacaa62cc5c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:34.228809 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b35a95b7-8eb8-4943-91fc-8cacaa62cc5c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:34.229512 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b35a95b7-8eb8-4943-91fc-8cacaa62cc5c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:34.229961 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b35a95b7-8eb8-4943-91fc-8cacaa62cc5c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:34.230380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b35a95b7-8eb8-4943-91fc-8cacaa62cc5c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:34.362418 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b35a95b7-8eb8-4943-91fc-8cacaa62cc5c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:34.370405 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b35a95b7-8eb8-4943-91fc-8cacaa62cc5c tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1680 microversion: 2.1 time: 0.154389 Aug 24 09:08:34.371036 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 625/1272] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:34 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:35.391387 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c5813fbf-e7e1-46ed-8dfc-99640ee3d098 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:35.392122 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c5813fbf-e7e1-46ed-8dfc-99640ee3d098 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:35.398638 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c5813fbf-e7e1-46ed-8dfc-99640ee3d098 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:35.399112 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c5813fbf-e7e1-46ed-8dfc-99640ee3d098 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:35.399546 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c5813fbf-e7e1-46ed-8dfc-99640ee3d098 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:35.400233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c5813fbf-e7e1-46ed-8dfc-99640ee3d098 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:35.400704 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c5813fbf-e7e1-46ed-8dfc-99640ee3d098 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:35.401120 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c5813fbf-e7e1-46ed-8dfc-99640ee3d098 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:35.540609 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-c5813fbf-e7e1-46ed-8dfc-99640ee3d098 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:35.548821 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c5813fbf-e7e1-46ed-8dfc-99640ee3d098 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1680 microversion: 2.1 time: 0.161291 Aug 24 09:08:35.549427 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 648/1273] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:35 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:36.570334 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1249a1c1-85be-45a8-9cf8-4c81314e9d80 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:36.570927 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1249a1c1-85be-45a8-9cf8-4c81314e9d80 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:36.577600 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1249a1c1-85be-45a8-9cf8-4c81314e9d80 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:36.578074 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1249a1c1-85be-45a8-9cf8-4c81314e9d80 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:36.578508 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1249a1c1-85be-45a8-9cf8-4c81314e9d80 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:36.579202 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1249a1c1-85be-45a8-9cf8-4c81314e9d80 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:36.579641 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1249a1c1-85be-45a8-9cf8-4c81314e9d80 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:36.580065 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1249a1c1-85be-45a8-9cf8-4c81314e9d80 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:36.720019 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1249a1c1-85be-45a8-9cf8-4c81314e9d80 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:36.728833 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1249a1c1-85be-45a8-9cf8-4c81314e9d80 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1680 microversion: 2.1 time: 0.162246 Aug 24 09:08:36.729416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 626/1274] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:36 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:37.752712 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e9a60e69-33fc-4896-915c-64ff911774df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:37.753319 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e9a60e69-33fc-4896-915c-64ff911774df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:37.759797 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e9a60e69-33fc-4896-915c-64ff911774df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:37.760271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e9a60e69-33fc-4896-915c-64ff911774df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:37.760732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e9a60e69-33fc-4896-915c-64ff911774df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:37.761539 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e9a60e69-33fc-4896-915c-64ff911774df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:37.761991 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e9a60e69-33fc-4896-915c-64ff911774df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:37.762405 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e9a60e69-33fc-4896-915c-64ff911774df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:37.898744 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e9a60e69-33fc-4896-915c-64ff911774df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:37.906424 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e9a60e69-33fc-4896-915c-64ff911774df tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1680 microversion: 2.1 time: 0.157614 Aug 24 09:08:37.907026 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 649/1275] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:37 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:38.929208 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-028d1a78-3208-42c8-b10b-eb1df26e8fee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:38.929810 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-028d1a78-3208-42c8-b10b-eb1df26e8fee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:38.936763 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-028d1a78-3208-42c8-b10b-eb1df26e8fee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:38.937330 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-028d1a78-3208-42c8-b10b-eb1df26e8fee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:38.937847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-028d1a78-3208-42c8-b10b-eb1df26e8fee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:38.938566 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-028d1a78-3208-42c8-b10b-eb1df26e8fee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:38.939018 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-028d1a78-3208-42c8-b10b-eb1df26e8fee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:38.939440 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-028d1a78-3208-42c8-b10b-eb1df26e8fee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:39.172168 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-028d1a78-3208-42c8-b10b-eb1df26e8fee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:39.180554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-028d1a78-3208-42c8-b10b-eb1df26e8fee tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1680 microversion: 2.1 time: 0.255743 Aug 24 09:08:39.181134 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 627/1276] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:38 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:08:39.850448 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-f3ccebc7-b6d4-4481-a6ad-8d95b6130137 req-43978377-595a-4eee-ab7e-47a3b1ac77a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e67a94-aad9-497d-90e2-da6f14343cf8", "name": "network-vif-deleted", "tag": "94a39355-84d1-41ed-92b5-bab82d04b265"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:08:39.861893 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-f3ccebc7-b6d4-4481-a6ad-8d95b6130137 req-43978377-595a-4eee-ab7e-47a3b1ac77a0 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:39.862415 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-f3ccebc7-b6d4-4481-a6ad-8d95b6130137 req-43978377-595a-4eee-ab7e-47a3b1ac77a0 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:39.862958 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-f3ccebc7-b6d4-4481-a6ad-8d95b6130137 req-43978377-595a-4eee-ab7e-47a3b1ac77a0 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:39.875047 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-f3ccebc7-b6d4-4481-a6ad-8d95b6130137 req-43978377-595a-4eee-ab7e-47a3b1ac77a0 service nova] Creating event network-vif-deleted:94a39355-84d1-41ed-92b5-bab82d04b265 for instance 84e67a94-aad9-497d-90e2-da6f14343cf8 on hv-cinder-85221 Aug 24 09:08:39.880208 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-f3ccebc7-b6d4-4481-a6ad-8d95b6130137 req-43978377-595a-4eee-ab7e-47a3b1ac77a0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033620 Aug 24 09:08:39.880944 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 650/1277] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:40.205757 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:40.206418 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:40.242402 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:40.242898 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:40.245770 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:40.245770 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:40.245770 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:40.245770 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:40.278328 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:40.278811 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:40.279302 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:40.279834 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lazy-loading 'fault' on Instance uuid 84e67a94-aad9-497d-90e2-da6f14343cf8 {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:08:40.327480 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993697d33b7841668b1eabcdcd6b40f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3809ac47fe214dda92729d4c89648a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:40.335398 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a305a362-0f87-4910-9501-154a2ea4b14e tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 200 len: 1332 microversion: 2.1 time: 0.137632 Aug 24 09:08:40.335996 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 628/1278] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:40 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 1332 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:41.357950 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b7e8daf2-53f5-41e8-9aa9-52d206657ce2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:41.358652 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b7e8daf2-53f5-41e8-9aa9-52d206657ce2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:41.365422 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b7e8daf2-53f5-41e8-9aa9-52d206657ce2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:41.374121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b7e8daf2-53f5-41e8-9aa9-52d206657ce2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:41.374121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b7e8daf2-53f5-41e8-9aa9-52d206657ce2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:41.374121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b7e8daf2-53f5-41e8-9aa9-52d206657ce2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:41.374121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b7e8daf2-53f5-41e8-9aa9-52d206657ce2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:41.374515 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b7e8daf2-53f5-41e8-9aa9-52d206657ce2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:41.382053 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-b7e8daf2-53f5-41e8-9aa9-52d206657ce2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b7e8daf2-53f5-41e8-9aa9-52d206657ce2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 HTTP/1.1 Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:08:41.384258 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:08:41.386106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:08:41.386106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:41.386106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:41.386106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:41.386106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:41.386106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:08:41.386106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:08:41.386106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:08:41.386106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:41.386106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:08:41.386106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:41.386106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '84e67a94-aad9-497d-90e2-da6f14343cf8'} Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:41.387073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:41.388692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:41.390113 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b7e8daf2-53f5-41e8-9aa9-52d206657ce2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 404 to user: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:41.390113 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b7e8daf2-53f5-41e8-9aa9-52d206657ce2 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 404 len: 111 microversion: 2.1 time: 0.032614 Aug 24 09:08:41.390113 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 651/1279] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:41 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:41.394856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cf62efe4-94a9-417a-b266-546afe739ebd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '.version_select at 0x7f16ae4d3ca0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:41.399439 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf62efe4-94a9-417a-b266-546afe739ebd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [00d1a155-16cb-4f7b-a31c-f18c33322ef4] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 09:08:42.407240 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf62efe4-94a9-417a-b266-546afe739ebd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [00d1a155-16cb-4f7b-a31c-f18c33322ef4] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 43644. Aug 24 09:08:42.523689 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-cf62efe4-94a9-417a-b266-546afe739ebd tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632512410" status: 202 len: 0 microversion: 2.1 time: 1.132499 Aug 24 09:08:42.524847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 629/1280] 10.222.0.55 () {58 vars in 1221 bytes} [Wed Aug 24 09:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632512410 => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:08:44.628851 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1a0c8ead-b2de-42fd-8589-972195b3fca3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:44.629571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1a0c8ead-b2de-42fd-8589-972195b3fca3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:44.636117 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1a0c8ead-b2de-42fd-8589-972195b3fca3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:44.636633 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1a0c8ead-b2de-42fd-8589-972195b3fca3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:44.637126 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1a0c8ead-b2de-42fd-8589-972195b3fca3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:44.637832 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1a0c8ead-b2de-42fd-8589-972195b3fca3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:44.638285 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1a0c8ead-b2de-42fd-8589-972195b3fca3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:44.638710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1a0c8ead-b2de-42fd-8589-972195b3fca3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:44.652027 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-1a0c8ead-b2de-42fd-8589-972195b3fca3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1a0c8ead-b2de-42fd-8589-972195b3fca3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: DELETE /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 HTTP/1.1 Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:08:44.653679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:08:44.659719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:08:44.659719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:44.659719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:44.659719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:44.659719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:44.659719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:08:44.659719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:08:44.659719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:08:44.659719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:44.659719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:08:44.659719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:44.659719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '84e67a94-aad9-497d-90e2-da6f14343cf8'} Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:44.660527 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:44.662315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:44.663875 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1a0c8ead-b2de-42fd-8589-972195b3fca3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 404 to user: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:44.663875 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1a0c8ead-b2de-42fd-8589-972195b3fca3 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 404 len: 111 microversion: 2.1 time: 0.030415 Aug 24 09:08:44.663875 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 652/1281] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:08:44 2022] DELETE /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:44.667177 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-da142846-9d8c-4e4d-8ca7-aa926dbbf589 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:44.667929 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-da142846-9d8c-4e4d-8ca7-aa926dbbf589 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 84e67a94-aad9-497d-90e2-da6f14343cf8] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:44.674755 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-da142846-9d8c-4e4d-8ca7-aa926dbbf589 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:44.675230 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-da142846-9d8c-4e4d-8ca7-aa926dbbf589 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:44.675661 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-da142846-9d8c-4e4d-8ca7-aa926dbbf589 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:44.676363 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-da142846-9d8c-4e4d-8ca7-aa926dbbf589 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:44.676870 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-da142846-9d8c-4e4d-8ca7-aa926dbbf589 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:44.681384 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-da142846-9d8c-4e4d-8ca7-aa926dbbf589 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:44.691275 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-da142846-9d8c-4e4d-8ca7-aa926dbbf589 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-da142846-9d8c-4e4d-8ca7-aa926dbbf589 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 HTTP/1.1 Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:08:44.692967 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:08:44.694588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:08:44.694588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:44.694588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:44.694588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:44.694588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:44.694588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:08:44.694588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:08:44.694588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:08:44.694588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:44.694588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:08:44.694588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:44.694588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': '84e67a94-aad9-497d-90e2-da6f14343cf8'} Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:44.695490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. Aug 24 09:08:44.696856 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:44.697985 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-da142846-9d8c-4e4d-8ca7-aa926dbbf589 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 404 to user: Instance 84e67a94-aad9-497d-90e2-da6f14343cf8 could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:44.697985 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-da142846-9d8c-4e4d-8ca7-aa926dbbf589 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8" status: 404 len: 111 microversion: 2.1 time: 0.032242 Aug 24 09:08:44.697985 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 630/1282] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:44 2022] GET /compute/v2.1/servers/84e67a94-aad9-497d-90e2-da6f14343cf8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:46.007821 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d93b7a36-e37b-44c0-998a-c67d1ca71a49 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:46.009200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d93b7a36-e37b-44c0-998a-c67d1ca71a49 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:46.016697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d93b7a36-e37b-44c0-998a-c67d1ca71a49 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:46.017304 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d93b7a36-e37b-44c0-998a-c67d1ca71a49 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:46.017646 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d93b7a36-e37b-44c0-998a-c67d1ca71a49 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:46.018381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d93b7a36-e37b-44c0-998a-c67d1ca71a49 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:46.018908 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d93b7a36-e37b-44c0-998a-c67d1ca71a49 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:46.019243 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d93b7a36-e37b-44c0-998a-c67d1ca71a49 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:46.033900 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-d93b7a36-e37b-44c0-998a-c67d1ca71a49 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d93b7a36-e37b-44c0-998a-c67d1ca71a49 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: DELETE /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b HTTP/1.1 Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:08:46.035484 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:08:46.037392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:08:46.037392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:46.037392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:46.037392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:46.037392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:46.037392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:08:46.037392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:08:46.037392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:08:46.037392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:46.037392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:08:46.037392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:08:46.037392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '63a4092a-a4bd-4e9d-b8f8-20b94ac1451b'} Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:46.038300 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:08:46.039878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.042033 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d93b7a36-e37b-44c0-998a-c67d1ca71a49 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 404 to user: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:46.042033 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d93b7a36-e37b-44c0-998a-c67d1ca71a49 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 404 len: 111 microversion: 2.1 time: 0.034327 Aug 24 09:08:46.042033 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 653/1283] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:08:46 2022] DELETE /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:46.045786 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5eb1cbf0-76ba-4532-ba0d-bc95d3e2dc57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:46.046389 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5eb1cbf0-76ba-4532-ba0d-bc95d3e2dc57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:46.052984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5eb1cbf0-76ba-4532-ba0d-bc95d3e2dc57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:46.053454 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5eb1cbf0-76ba-4532-ba0d-bc95d3e2dc57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:46.053880 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5eb1cbf0-76ba-4532-ba0d-bc95d3e2dc57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:46.054557 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5eb1cbf0-76ba-4532-ba0d-bc95d3e2dc57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:46.054998 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5eb1cbf0-76ba-4532-ba0d-bc95d3e2dc57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:46.055455 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5eb1cbf0-76ba-4532-ba0d-bc95d3e2dc57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:46.069132 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-5eb1cbf0-76ba-4532-ba0d-bc95d3e2dc57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5eb1cbf0-76ba-4532-ba0d-bc95d3e2dc57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b HTTP/1.1 Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:08:46.071183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:08:46.076111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:08:46.076111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:46.076111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:46.076111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:46.076111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:46.076111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:08:46.076111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:08:46.076111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:08:46.076111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:46.076111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:08:46.076111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:08:46.076111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': '63a4092a-a4bd-4e9d-b8f8-20b94ac1451b'} Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:46.077494 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. Aug 24 09:08:46.079110 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.080508 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5eb1cbf0-76ba-4532-ba0d-bc95d3e2dc57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 404 to user: Instance 63a4092a-a4bd-4e9d-b8f8-20b94ac1451b could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:46.080508 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5eb1cbf0-76ba-4532-ba0d-bc95d3e2dc57 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b" status: 404 len: 111 microversion: 2.1 time: 0.030593 Aug 24 09:08:46.080508 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 631/1284] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:46 2022] GET /compute/v2.1/servers/63a4092a-a4bd-4e9d-b8f8-20b94ac1451b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 09:08:46.081112 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5e3e5f9c-2d99-4d59-8a33-9811b3e1d2e7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:46.081443 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5e3e5f9c-2d99-4d59-8a33-9811b3e1d2e7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:46.087950 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5e3e5f9c-2d99-4d59-8a33-9811b3e1d2e7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:46.090121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5e3e5f9c-2d99-4d59-8a33-9811b3e1d2e7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:46.090121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5e3e5f9c-2d99-4d59-8a33-9811b3e1d2e7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:46.090121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5e3e5f9c-2d99-4d59-8a33-9811b3e1d2e7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:46.090121 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5e3e5f9c-2d99-4d59-8a33-9811b3e1d2e7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:46.090576 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5e3e5f9c-2d99-4d59-8a33-9811b3e1d2e7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:46.106155 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-5e3e5f9c-2d99-4d59-8a33-9811b3e1d2e7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5e3e5f9c-2d99-4d59-8a33-9811b3e1d2e7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: DELETE /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 HTTP/1.1 Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:08:46.108038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:08:46.109679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:08:46.109679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:46.109679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:46.109679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:46.109679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:46.109679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:08:46.109679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:08:46.109679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:08:46.109679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:46.109679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:08:46.109679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:08:46.109679 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '713b8af9-0654-40a5-bae9-0592267a0458'} Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:46.110591 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:08:46.112186 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.113771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5e3e5f9c-2d99-4d59-8a33-9811b3e1d2e7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 404 to user: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:46.113771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5e3e5f9c-2d99-4d59-8a33-9811b3e1d2e7 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 404 len: 111 microversion: 2.1 time: 0.031840 Aug 24 09:08:46.113771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 654/1285] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:08:46 2022] DELETE /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 09:08:46.117519 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7185614d-d645-4278-b4c9-561ce16699b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:46.118151 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-7185614d-d645-4278-b4c9-561ce16699b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 713b8af9-0654-40a5-bae9-0592267a0458] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:46.124290 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7185614d-d645-4278-b4c9-561ce16699b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:46.124808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7185614d-d645-4278-b4c9-561ce16699b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:46.125243 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7185614d-d645-4278-b4c9-561ce16699b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:46.125929 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7185614d-d645-4278-b4c9-561ce16699b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:46.126372 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7185614d-d645-4278-b4c9-561ce16699b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:46.126787 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7185614d-d645-4278-b4c9-561ce16699b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:46.140788 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-7185614d-d645-4278-b4c9-561ce16699b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7185614d-d645-4278-b4c9-561ce16699b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 HTTP/1.1 Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:08:46.142360 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:08:46.144053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:08:46.144053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:46.144053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:46.144053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:46.144053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:46.144053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:08:46.144053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:08:46.144053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:08:46.144053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:46.144053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:08:46.144053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:08:46.144053 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': '713b8af9-0654-40a5-bae9-0592267a0458'} Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:46.145049 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. Aug 24 09:08:46.146376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:46.147496 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7185614d-d645-4278-b4c9-561ce16699b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 404 to user: Instance 713b8af9-0654-40a5-bae9-0592267a0458 could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:46.147496 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7185614d-d645-4278-b4c9-561ce16699b4 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458" status: 404 len: 111 microversion: 2.1 time: 0.029967 Aug 24 09:08:46.147496 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 632/1286] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:46 2022] GET /compute/v2.1/servers/713b8af9-0654-40a5-bae9-0592267a0458 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:47.412777 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c6ad4caf-e778-48c7-8d94-05e1a137f3c8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:47.413559 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-c6ad4caf-e778-48c7-8d94-05e1a137f3c8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:47.421595 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c6ad4caf-e778-48c7-8d94-05e1a137f3c8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:47.422045 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c6ad4caf-e778-48c7-8d94-05e1a137f3c8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:47.422953 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c6ad4caf-e778-48c7-8d94-05e1a137f3c8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:47.424058 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c6ad4caf-e778-48c7-8d94-05e1a137f3c8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:47.424633 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c6ad4caf-e778-48c7-8d94-05e1a137f3c8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:47.425163 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-c6ad4caf-e778-48c7-8d94-05e1a137f3c8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:47.439574 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-c6ad4caf-e778-48c7-8d94-05e1a137f3c8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c6ad4caf-e778-48c7-8d94-05e1a137f3c8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: DELETE /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c HTTP/1.1 Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:08:47.441153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:08:47.442805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:08:47.442805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:47.442805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:47.442805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:47.442805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:47.442805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:08:47.442805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:08:47.442805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:08:47.442805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:47.442805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:08:47.442805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:08:47.442805 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '635351cd-1139-4659-9d13-086372a9af7c'} Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:47.447451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:08:47.449040 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:47.450622 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-c6ad4caf-e778-48c7-8d94-05e1a137f3c8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 404 to user: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:47.450622 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-c6ad4caf-e778-48c7-8d94-05e1a137f3c8 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "DELETE /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 404 len: 111 microversion: 2.1 time: 0.034507 Aug 24 09:08:47.450622 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 655/1287] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:08:47 2022] DELETE /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:47.451736 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-efea0ccd-d1cf-4a4e-8a00-255f000710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:47.452344 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-efea0ccd-d1cf-4a4e-8a00-255f000710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] [instance: 635351cd-1139-4659-9d13-086372a9af7c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:47.459208 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efea0ccd-d1cf-4a4e-8a00-255f000710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:47.459682 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efea0ccd-d1cf-4a4e-8a00-255f000710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:47.460196 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efea0ccd-d1cf-4a4e-8a00-255f000710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:47.460915 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efea0ccd-d1cf-4a4e-8a00-255f000710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:47.461400 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efea0ccd-d1cf-4a4e-8a00-255f000710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:47.467546 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-efea0ccd-d1cf-4a4e-8a00-255f000710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:47.476189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-efea0ccd-d1cf-4a4e-8a00-255f000710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] HTTP exception thrown: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-efea0ccd-d1cf-4a4e-8a00-255f000710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Request method failure captured: Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c HTTP/1.1 Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeQ784C-5gQp2Jb1qE6mgRUVCRFnI73OFXJ6cqhGAtUq4jMFD7_4rYS4izvfDkVlbOSEGjrwoiCAMYxbwxBrBk2Xyvf-aEhtV_H7Y_bmHGjqq3JvBe9RWW6e_R5F_IsPb82KL_e07SgIw9XS4TlSScZcGuKJC38oGXR5etcWaS_XdI Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:08:47.477772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:08:47.479459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3809ac47fe214dda92729d4c89648a17", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3809ac47fe214dda92729d4c89648a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:08:47.479459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:47.479459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 3809ac47fe214dda92729d4c89648a17 Aug 24 09:08:47.479459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-316998482 Aug 24 09:08:47.479459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:47.479459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:08:47.479459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:08:47.479459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 993697d33b7841668b1eabcdcd6b40f9 Aug 24 09:08:47.479459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-AttachVolumeNegativeTest-316998482-project Aug 24 09:08:47.479459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:08:47.479459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:08:47.479459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': '635351cd-1139-4659-9d13-086372a9af7c'} Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:47.480296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. Aug 24 09:08:47.481666 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:08:47.482838 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-efea0ccd-d1cf-4a4e-8a00-255f000710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] Returning 404 to user: Instance 635351cd-1139-4659-9d13-086372a9af7c could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:47.482838 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-efea0ccd-d1cf-4a4e-8a00-255f000710d9 tempest-AttachVolumeNegativeTest-316998482 tempest-AttachVolumeNegativeTest-316998482-project] 10.222.0.55 "GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c" status: 404 len: 111 microversion: 2.1 time: 0.031427 Aug 24 09:08:47.482838 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 633/1288] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:47 2022] GET /compute/v2.1/servers/635351cd-1139-4659-9d13-086372a9af7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:49.558753 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-383400222", "imageRef": "58965b74-399c-4c40-86df-55a6d6f4a646", "flavorRef": "452"}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:08:49.625467 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.network.neutron [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] validate_networks() for None {{(pid=132984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:08:49.953046 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Flavor limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:08:49.953797 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Image limits 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:08:49.954468 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Flavor pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:08:49.954878 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Image pref 0:0:0 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:08:49.955294 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.virt.hardware [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:08:49.965511 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:49.966311 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:49.966772 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:49.971970 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:49.971970 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:49.971970 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:49.992492 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Getting quotas for project bccb7b3c5c2844eb84a115fa60b186ff. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:08:49.997787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.quota [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Getting quotas for user 5c030e83e1cc40609d901de3ed82a90e and project bccb7b3c5c2844eb84a115fa60b186ff. Resources: {'ram', 'instances', 'cores'} {{(pid=132984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:08:50.010570 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Going to run 1 instances... {{(pid=132984) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:08:50.014191 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58965b74-399c-4c40-86df-55a6d6f4a646',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:08:50.123251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-bbe93451-60cc-4655-8540-e3ebbf0216c3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568717 Aug 24 09:08:50.123936 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 656/1289] 10.222.0.55 () {60 vars in 1147 bytes} [Wed Aug 24 09:08:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:08:50.134953 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b6cb2d17-fc3e-4183-919d-9cd3d8c25f3c tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:50.136177 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b6cb2d17-fc3e-4183-919d-9cd3d8c25f3c tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:50.195443 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b6cb2d17-fc3e-4183-919d-9cd3d8c25f3c tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:50.203041 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b6cb2d17-fc3e-4183-919d-9cd3d8c25f3c tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1214 microversion: 2.1 time: 0.071981 Aug 24 09:08:50.203612 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 634/1290] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:50 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:51.225047 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0c756931-e20f-478c-8a8c-3ad09b926050 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:51.225558 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0c756931-e20f-478c-8a8c-3ad09b926050 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:51.232759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0c756931-e20f-478c-8a8c-3ad09b926050 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:51.233245 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0c756931-e20f-478c-8a8c-3ad09b926050 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:51.233682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0c756931-e20f-478c-8a8c-3ad09b926050 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:51.234433 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0c756931-e20f-478c-8a8c-3ad09b926050 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:51.234825 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0c756931-e20f-478c-8a8c-3ad09b926050 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:51.235246 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0c756931-e20f-478c-8a8c-3ad09b926050 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:51.301648 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0c756931-e20f-478c-8a8c-3ad09b926050 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:51.309185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0c756931-e20f-478c-8a8c-3ad09b926050 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1218 microversion: 2.1 time: 0.088605 Aug 24 09:08:51.310175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 657/1291] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:51 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:51.437538 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-dea08305-1131-459a-aa41-2ec234ad8657 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:51.443385 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-dea08305-1131-459a-aa41-2ec234ad8657 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:51.447595 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dea08305-1131-459a-aa41-2ec234ad8657 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:51.448072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dea08305-1131-459a-aa41-2ec234ad8657 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:51.448515 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dea08305-1131-459a-aa41-2ec234ad8657 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:51.449219 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dea08305-1131-459a-aa41-2ec234ad8657 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:51.449661 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dea08305-1131-459a-aa41-2ec234ad8657 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:51.450078 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dea08305-1131-459a-aa41-2ec234ad8657 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:51.493804 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-dea08305-1131-459a-aa41-2ec234ad8657 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060176 Aug 24 09:08:51.495114 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 635/1292] 10.222.0.55 () {60 vars in 1343 bytes} [Wed Aug 24 09:08:51 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:51.564466 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-19c9fba4-aebc-4f38-bad9-dc91fd541f9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:51.568613 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-19c9fba4-aebc-4f38-bad9-dc91fd541f9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:51.571416 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-19c9fba4-aebc-4f38-bad9-dc91fd541f9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:51.572556 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-19c9fba4-aebc-4f38-bad9-dc91fd541f9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:51.573108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-19c9fba4-aebc-4f38-bad9-dc91fd541f9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:51.573804 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-19c9fba4-aebc-4f38-bad9-dc91fd541f9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:51.574243 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-19c9fba4-aebc-4f38-bad9-dc91fd541f9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:51.574660 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-19c9fba4-aebc-4f38-bad9-dc91fd541f9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:51.599639 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-19c9fba4-aebc-4f38-bad9-dc91fd541f9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Going to try to terminate instance {{(pid=132984) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:08:51.935008 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-19c9fba4-aebc-4f38-bad9-dc91fd541f9f tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "DELETE /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 204 len: 0 microversion: 2.20 time: 0.375963 Aug 24 09:08:51.935916 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 658/1293] 10.222.0.55 () {60 vars in 1280 bytes} [Wed Aug 24 09:08:51 2022] DELETE /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 09:08:51.944464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-7fbcc39d-1bfa-474b-9322-92dc2bde4c5b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:51.945094 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-7fbcc39d-1bfa-474b-9322-92dc2bde4c5b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:51.951037 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7fbcc39d-1bfa-474b-9322-92dc2bde4c5b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:51.951524 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7fbcc39d-1bfa-474b-9322-92dc2bde4c5b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:51.951944 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7fbcc39d-1bfa-474b-9322-92dc2bde4c5b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:51.952662 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7fbcc39d-1bfa-474b-9322-92dc2bde4c5b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:51.953111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7fbcc39d-1bfa-474b-9322-92dc2bde4c5b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:51.953531 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-7fbcc39d-1bfa-474b-9322-92dc2bde4c5b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:52.149881 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7fbcc39d-1bfa-474b-9322-92dc2bde4c5b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:52.158446 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7fbcc39d-1bfa-474b-9322-92dc2bde4c5b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:52.159977 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-7fbcc39d-1bfa-474b-9322-92dc2bde4c5b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:52.161428 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-7fbcc39d-1bfa-474b-9322-92dc2bde4c5b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.220973 Aug 24 09:08:52.161978 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 636/1294] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:08:51 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:08:52.332507 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2c5a4d0e-e33a-4ca2-8a0b-e94232e2eb10 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:52.333852 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2c5a4d0e-e33a-4ca2-8a0b-e94232e2eb10 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:52.340651 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c5a4d0e-e33a-4ca2-8a0b-e94232e2eb10 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:52.341154 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c5a4d0e-e33a-4ca2-8a0b-e94232e2eb10 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:52.341588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c5a4d0e-e33a-4ca2-8a0b-e94232e2eb10 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:52.342271 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c5a4d0e-e33a-4ca2-8a0b-e94232e2eb10 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:52.342715 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c5a4d0e-e33a-4ca2-8a0b-e94232e2eb10 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:52.343128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2c5a4d0e-e33a-4ca2-8a0b-e94232e2eb10 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:52.406847 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2c5a4d0e-e33a-4ca2-8a0b-e94232e2eb10 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:52.414902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2c5a4d0e-e33a-4ca2-8a0b-e94232e2eb10 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1266 microversion: 2.1 time: 0.086585 Aug 24 09:08:52.415464 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 659/1295] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:52 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:53.185309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-47c5e6db-9837-40dd-8c36-ba7530db4b0b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:53.185916 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-47c5e6db-9837-40dd-8c36-ba7530db4b0b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:53.192444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47c5e6db-9837-40dd-8c36-ba7530db4b0b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:53.192955 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47c5e6db-9837-40dd-8c36-ba7530db4b0b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:53.193385 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47c5e6db-9837-40dd-8c36-ba7530db4b0b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:53.194112 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47c5e6db-9837-40dd-8c36-ba7530db4b0b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:53.194554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47c5e6db-9837-40dd-8c36-ba7530db4b0b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:53.194969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-47c5e6db-9837-40dd-8c36-ba7530db4b0b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:53.335598 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-47c5e6db-9837-40dd-8c36-ba7530db4b0b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:53.344109 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-47c5e6db-9837-40dd-8c36-ba7530db4b0b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:53.345727 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-47c5e6db-9837-40dd-8c36-ba7530db4b0b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:53.346992 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-47c5e6db-9837-40dd-8c36-ba7530db4b0b tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.166345 Aug 24 09:08:53.358852 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 637/1296] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:08:53 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:08:53.392768 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1ff0d745-aa8b-4a98-b0f7-d16896872592 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Action: 'create', calling method: .version_select at 0x7f16b2c26ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-189332385"}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:08:53.437768 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f5c5eacf-92e1-429f-8cec-041b2abbf22e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:53.438372 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f5c5eacf-92e1-429f-8cec-041b2abbf22e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:53.444381 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f5c5eacf-92e1-429f-8cec-041b2abbf22e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:53.444891 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f5c5eacf-92e1-429f-8cec-041b2abbf22e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:53.445319 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f5c5eacf-92e1-429f-8cec-041b2abbf22e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:53.446004 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f5c5eacf-92e1-429f-8cec-041b2abbf22e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:53.446452 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f5c5eacf-92e1-429f-8cec-041b2abbf22e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:53.446866 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f5c5eacf-92e1-429f-8cec-041b2abbf22e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:53.509237 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f5c5eacf-92e1-429f-8cec-041b2abbf22e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:53.517251 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f5c5eacf-92e1-429f-8cec-041b2abbf22e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1266 microversion: 2.1 time: 0.083224 Aug 24 09:08:53.517755 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 638/1297] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:53 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:08:54.017241 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1ff0d745-aa8b-4a98-b0f7-d16896872592 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.749683 Aug 24 09:08:54.017864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 660/1298] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Aug 24 09:08:53 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 751 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 24 09:08:54.030885 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1976f8d6-1268-44c1-93ee-722a1ef6a174 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16b2be6c10>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:54.099668 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1976f8d6-1268-44c1-93ee-722a1ef6a174 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621" status: 200 len: 344 microversion: 2.1 time: 0.072751 Aug 24 09:08:54.100296 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 639/1299] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 09:08:54 2022] GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621 => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:54.370242 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d4814eca-49fe-445d-963a-c4f737761ba2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:54.372571 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d4814eca-49fe-445d-963a-c4f737761ba2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:54.378072 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4814eca-49fe-445d-963a-c4f737761ba2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:54.378555 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4814eca-49fe-445d-963a-c4f737761ba2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:54.378988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4814eca-49fe-445d-963a-c4f737761ba2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:54.380015 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4814eca-49fe-445d-963a-c4f737761ba2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:54.380468 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4814eca-49fe-445d-963a-c4f737761ba2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:54.380914 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4814eca-49fe-445d-963a-c4f737761ba2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:54.401699 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:54.539767 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-71e278b1-543f-447f-8475-03b9187b72d9 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:54.540404 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-71e278b1-543f-447f-8475-03b9187b72d9 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:54.546560 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-71e278b1-543f-447f-8475-03b9187b72d9 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:54.547131 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-71e278b1-543f-447f-8475-03b9187b72d9 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:54.547552 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-71e278b1-543f-447f-8475-03b9187b72d9 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:54.548317 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-71e278b1-543f-447f-8475-03b9187b72d9 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:54.548822 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-71e278b1-543f-447f-8475-03b9187b72d9 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:54.549246 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-71e278b1-543f-447f-8475-03b9187b72d9 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:54.573626 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d4814eca-49fe-445d-963a-c4f737761ba2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:54.575519 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d4814eca-49fe-445d-963a-c4f737761ba2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:54.577210 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d4814eca-49fe-445d-963a-c4f737761ba2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:54.578513 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d4814eca-49fe-445d-963a-c4f737761ba2 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1724 microversion: 2.20 time: 0.212182 Aug 24 09:08:54.579178 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 661/1300] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:08:54 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:08:54.630867 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-71e278b1-543f-447f-8475-03b9187b72d9 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:54.639587 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-71e278b1-543f-447f-8475-03b9187b72d9 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1272 microversion: 2.1 time: 0.104495 Aug 24 09:08:54.640157 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 640/1301] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:54 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:08:54.982289 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-fc4ea79e-958c-4442-b524-4128a2c9e43f req-bc3982bc-918c-4aea-9245-d6462cbe27e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fe50f9-e517-4e9a-80b5-6faba0b9f10a", "name": "network-vif-deleted", "tag": "8d40ee89-fb81-4d38-99c2-3dac67fab1b0"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:08:54.993656 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-fc4ea79e-958c-4442-b524-4128a2c9e43f req-bc3982bc-918c-4aea-9245-d6462cbe27e8 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:54.994327 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-fc4ea79e-958c-4442-b524-4128a2c9e43f req-bc3982bc-918c-4aea-9245-d6462cbe27e8 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:54.995388 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-fc4ea79e-958c-4442-b524-4128a2c9e43f req-bc3982bc-918c-4aea-9245-d6462cbe27e8 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:55.007717 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-fc4ea79e-958c-4442-b524-4128a2c9e43f req-bc3982bc-918c-4aea-9245-d6462cbe27e8 service nova] Creating event network-vif-deleted:8d40ee89-fb81-4d38-99c2-3dac67fab1b0 for instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a on hv-cinder-85221 Aug 24 09:08:55.013695 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-fc4ea79e-958c-4442-b524-4128a2c9e43f req-bc3982bc-918c-4aea-9245-d6462cbe27e8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036673 Aug 24 09:08:55.014348 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 662/1302] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:55.115405 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-bf35e617-2bad-4200-8184-cd5b3e0d193a tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16b2be6e50>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:55.210839 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-bf35e617-2bad-4200-8184-cd5b3e0d193a tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621" status: 200 len: 344 microversion: 2.1 time: 0.099100 Aug 24 09:08:55.218438 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 641/1303] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 09:08:55 2022] GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:55.603260 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:55.604604 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:55.612810 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:55.613494 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:55.613922 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:55.614628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:55.615077 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:55.615672 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:55.653761 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:55.655873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:55.655873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:55.655873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lazy-loading 'fault' on Instance uuid 97fe50f9-e517-4e9a-80b5-6faba0b9f10a {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:08:55.661217 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-50db89dc-b6c0-4738-a2c1-aca8a653f6c5 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:55.662445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-50db89dc-b6c0-4738-a2c1-aca8a653f6c5 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:55.680935 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-50db89dc-b6c0-4738-a2c1-aca8a653f6c5 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:55.681490 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-50db89dc-b6c0-4738-a2c1-aca8a653f6c5 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:55.693427 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-50db89dc-b6c0-4738-a2c1-aca8a653f6c5 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:55.694112 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-50db89dc-b6c0-4738-a2c1-aca8a653f6c5 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:55.694778 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-50db89dc-b6c0-4738-a2c1-aca8a653f6c5 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:55.695207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-50db89dc-b6c0-4738-a2c1-aca8a653f6c5 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:55.722041 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:55.732995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:55.735318 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1105970982014891902ebbb9904a57a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69447ca2f314084925442b7f8c9ee2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:55.736721 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-97da3d88-02cc-449a-941c-903c96da59a6 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 200 len: 1372 microversion: 2.20 time: 0.138336 Aug 24 09:08:55.738145 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 663/1304] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:08:55 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 1372 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:08:55.954115 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-50db89dc-b6c0-4738-a2c1-aca8a653f6c5 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:55.962717 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-50db89dc-b6c0-4738-a2c1-aca8a653f6c5 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1314 microversion: 2.1 time: 0.305702 Aug 24 09:08:55.963354 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 642/1305] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:55 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:08:56.224352 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f02cd1c4-7d47-411f-98a5-fd46094ec13d tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16b2bf38b0>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:56.281029 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f02cd1c4-7d47-411f-98a5-fd46094ec13d tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621" status: 200 len: 345 microversion: 2.1 time: 0.060403 Aug 24 09:08:56.282127 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 664/1306] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 09:08:56 2022] GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:56.296767 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-48182b06-9016-4cd7-b1c2-7ffc0ecc8dfa tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Action: 'create', calling method: .version_select at 0x7f16ae3b70d0>, body: {"snapshot": {"volume_id": "c96ed941-3896-4428-a8ae-882a4673d621", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-31174970"}} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:08:56.420004 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-9d8d039c-f9c2-457a-bc32-d12224d724d0 req-b04ace8a-0948-490a-9226-8772b9a1e2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfca5034-37c3-48af-9404-0f54934b89c2", "tag": "9885771e-35df-45c2-b301-b0d71c55b1c0"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:08:56.430259 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-9d8d039c-f9c2-457a-bc32-d12224d724d0 req-b04ace8a-0948-490a-9226-8772b9a1e2f3 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:56.430988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-9d8d039c-f9c2-457a-bc32-d12224d724d0 req-b04ace8a-0948-490a-9226-8772b9a1e2f3 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:56.431584 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-9d8d039c-f9c2-457a-bc32-d12224d724d0 req-b04ace8a-0948-490a-9226-8772b9a1e2f3 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:56.445277 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-9d8d039c-f9c2-457a-bc32-d12224d724d0 req-b04ace8a-0948-490a-9226-8772b9a1e2f3 service nova] Creating event network-changed:9885771e-35df-45c2-b301-b0d71c55b1c0 for instance bfca5034-37c3-48af-9404-0f54934b89c2 on hv-cinder-85221 Aug 24 09:08:56.450128 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-9d8d039c-f9c2-457a-bc32-d12224d724d0 req-b04ace8a-0948-490a-9226-8772b9a1e2f3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034409 Aug 24 09:08:56.450749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 665/1307] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:08:56.765109 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d4b3cd1e-1e55-4cc5-b916-976b15aa32b3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:56.765791 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d4b3cd1e-1e55-4cc5-b916-976b15aa32b3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:56.772059 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4b3cd1e-1e55-4cc5-b916-976b15aa32b3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:56.772568 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4b3cd1e-1e55-4cc5-b916-976b15aa32b3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:56.773000 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4b3cd1e-1e55-4cc5-b916-976b15aa32b3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:56.773701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4b3cd1e-1e55-4cc5-b916-976b15aa32b3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:56.774152 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4b3cd1e-1e55-4cc5-b916-976b15aa32b3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:56.774574 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d4b3cd1e-1e55-4cc5-b916-976b15aa32b3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:56.789084 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-d4b3cd1e-1e55-4cc5-b916-976b15aa32b3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] HTTP exception thrown: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d4b3cd1e-1e55-4cc5-b916-976b15aa32b3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Request method failure captured: Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a HTTP/1.1 Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeeS0VUTeaa4dQaFYAYtjGSAAH8CQ1jkTUMTLWdMuu2xN652lZr9uyUXik2VGDZNXALBwEUuzm5UFU1nuXz6mP8-9mv72c84JmwmibslJ-fUIlh7Z5W7GW54kI9yRPyPC7IqtoG-ZlnuTN8o1RfQh982xowr-0cuefNRE4y8XqTBq_w Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: a69447ca2f314084925442b7f8c9ee2e Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:08:56.791262 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:08:56.793732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a69447ca2f314084925442b7f8c9ee2e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:08:56.793732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:08:56.793732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: a69447ca2f314084925442b7f8c9ee2e Aug 24 09:08:56.793732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:08:56.793732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-AttachVolumeShelveTestJSON-1781178415-project Aug 24 09:08:56.793732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:08:56.793732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:08:56.793732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: 1105970982014891902ebbb9904a57a5 Aug 24 09:08:56.793732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781178415-project Aug 24 09:08:56.793732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:08:56.793732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:08:56.793732 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '97fe50f9-e517-4e9a-80b5-6faba0b9f10a'} Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:56.794790 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:08:56.796268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:08:56.804604 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-48182b06-9016-4cd7-b1c2-7ffc0ecc8dfa tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.501758 Aug 24 09:08:56.804604 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 643/1308] 10.222.0.55 () {60 vars in 1162 bytes} [Wed Aug 24 09:08:56 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:56.805347 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d4b3cd1e-1e55-4cc5-b916-976b15aa32b3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Returning 404 to user: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:56.805347 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d4b3cd1e-1e55-4cc5-b916-976b15aa32b3 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 404 len: 111 microversion: 2.20 time: 0.038425 Aug 24 09:08:56.805347 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 666/1309] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:08:56 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 09:08:56.805672 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-68b85e65-911c-42cb-a4eb-ab326387ee3b tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16ae4dfdc0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:56.807472 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3e5d092d-016a-4780-a23f-aaf1663ced46 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '.version_select at 0x7f16ae3a1ee0>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:56.843839 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-68b85e65-911c-42cb-a4eb-ab326387ee3b tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f" status: 200 len: 285 microversion: 2.1 time: 0.041852 Aug 24 09:08:56.844584 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 644/1310] 10.222.0.55 () {58 vars in 1251 bytes} [Wed Aug 24 09:08:56 2022] GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f => generated 285 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:56.856189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b1ebb8b6-9ea8-4f70-962d-aa9b7cb79559 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16ae4d3790>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:56.891216 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b1ebb8b6-9ea8-4f70-962d-aa9b7cb79559 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.039196 Aug 24 09:08:56.891820 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 645/1311] 10.222.0.55 () {58 vars in 1140 bytes} [Wed Aug 24 09:08:56 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:08:56.910652 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d8e5e3a4-3ef7-4d4d-a983-e94952516b60 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16b2be6b80>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:56.918660 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3e5d092d-016a-4780-a23f-aaf1663ced46 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107859687" status: 204 len: 0 microversion: 2.20 time: 0.114886 Aug 24 09:08:56.924387 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 667/1312] 10.222.0.55 () {60 vars in 1262 bytes} [Wed Aug 24 09:08:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107859687 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 09:08:56.947964 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d8e5e3a4-3ef7-4d4d-a983-e94952516b60 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f" status: 200 len: 285 microversion: 2.1 time: 0.040693 Aug 24 09:08:56.948718 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 646/1313] 10.222.0.55 () {58 vars in 1251 bytes} [Wed Aug 24 09:08:56 2022] GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f => generated 285 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:08:56.984340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-2e5eb6fa-bda4-494a-9f3b-2e2ca59458c2 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:56.987674 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-2e5eb6fa-bda4-494a-9f3b-2e2ca59458c2 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:56.992880 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2e5eb6fa-bda4-494a-9f3b-2e2ca59458c2 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:56.993560 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2e5eb6fa-bda4-494a-9f3b-2e2ca59458c2 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:56.993996 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2e5eb6fa-bda4-494a-9f3b-2e2ca59458c2 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:56.994749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2e5eb6fa-bda4-494a-9f3b-2e2ca59458c2 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:56.995199 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2e5eb6fa-bda4-494a-9f3b-2e2ca59458c2 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:56.995628 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-2e5eb6fa-bda4-494a-9f3b-2e2ca59458c2 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:57.156239 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-2e5eb6fa-bda4-494a-9f3b-2e2ca59458c2 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:57.164832 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-2e5eb6fa-bda4-494a-9f3b-2e2ca59458c2 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1314 microversion: 2.1 time: 0.185387 Aug 24 09:08:57.165554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 668/1314] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:56 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:57.961226 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1efd8471-4366-451c-a1ab-b78b4e2a338a tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16ae4d3ca0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:57.990813 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1efd8471-4366-451c-a1ab-b78b4e2a338a tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f" status: 200 len: 285 microversion: 2.1 time: 0.033935 Aug 24 09:08:57.991543 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 647/1315] 10.222.0.55 () {58 vars in 1251 bytes} [Wed Aug 24 09:08:57 2022] GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:58.248838 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7082a079-4e49-4dd1-9ef2-558d3f8a208b tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:58.249455 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7082a079-4e49-4dd1-9ef2-558d3f8a208b tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:58.256171 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7082a079-4e49-4dd1-9ef2-558d3f8a208b tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:58.258707 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7082a079-4e49-4dd1-9ef2-558d3f8a208b tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:58.258707 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7082a079-4e49-4dd1-9ef2-558d3f8a208b tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:58.258707 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7082a079-4e49-4dd1-9ef2-558d3f8a208b tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:58.258707 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7082a079-4e49-4dd1-9ef2-558d3f8a208b tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:58.259110 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7082a079-4e49-4dd1-9ef2-558d3f8a208b tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:58.394909 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7082a079-4e49-4dd1-9ef2-558d3f8a208b tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:58.403072 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7082a079-4e49-4dd1-9ef2-558d3f8a208b tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1314 microversion: 2.1 time: 0.158787 Aug 24 09:08:58.403633 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 669/1316] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:58 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:08:59.004900 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e77ee1b7-7866-4b0e-99ed-e039ff6f4aba tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16ae4751f0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:59.037483 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e77ee1b7-7866-4b0e-99ed-e039ff6f4aba tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f" status: 200 len: 285 microversion: 2.1 time: 0.036979 Aug 24 09:08:59.038055 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 648/1317] 10.222.0.55 () {58 vars in 1251 bytes} [Wed Aug 24 09:08:58 2022] GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f => generated 285 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:59.423750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-21a0012f-7f60-48cc-8598-ea6110f4dffb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:59.424384 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-21a0012f-7f60-48cc-8598-ea6110f4dffb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:59.426827 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:59.431593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-21a0012f-7f60-48cc-8598-ea6110f4dffb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:59.432075 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-21a0012f-7f60-48cc-8598-ea6110f4dffb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:59.433097 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-21a0012f-7f60-48cc-8598-ea6110f4dffb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:59.433800 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-21a0012f-7f60-48cc-8598-ea6110f4dffb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:59.434247 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-21a0012f-7f60-48cc-8598-ea6110f4dffb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:59.434669 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-21a0012f-7f60-48cc-8598-ea6110f4dffb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:59.567860 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-21a0012f-7f60-48cc-8598-ea6110f4dffb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:59.575547 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-21a0012f-7f60-48cc-8598-ea6110f4dffb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1314 microversion: 2.1 time: 0.155687 Aug 24 09:08:59.576101 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 670/1318] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:59 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:00.050403 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-20d75346-8b4e-41fa-a088-c77b48cf8305 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16ae3914c0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:00.079668 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-20d75346-8b4e-41fa-a088-c77b48cf8305 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f" status: 200 len: 285 microversion: 2.1 time: 0.033393 Aug 24 09:09:00.080248 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 649/1319] 10.222.0.55 () {58 vars in 1251 bytes} [Wed Aug 24 09:09:00 2022] GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:00.595753 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5100cfb3-f2d1-4b8a-93fc-38a4e3fffe87 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:00.596407 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5100cfb3-f2d1-4b8a-93fc-38a4e3fffe87 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:00.598270 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:00.598929 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell0:SELECT=6 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:00.604843 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5100cfb3-f2d1-4b8a-93fc-38a4e3fffe87 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:00.606087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5100cfb3-f2d1-4b8a-93fc-38a4e3fffe87 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:00.606087 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5100cfb3-f2d1-4b8a-93fc-38a4e3fffe87 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:00.606456 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5100cfb3-f2d1-4b8a-93fc-38a4e3fffe87 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:00.606908 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5100cfb3-f2d1-4b8a-93fc-38a4e3fffe87 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:00.607331 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5100cfb3-f2d1-4b8a-93fc-38a4e3fffe87 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:00.740780 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5100cfb3-f2d1-4b8a-93fc-38a4e3fffe87 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:00.748531 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5100cfb3-f2d1-4b8a-93fc-38a4e3fffe87 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1314 microversion: 2.1 time: 0.156657 Aug 24 09:09:00.749114 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 671/1320] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:00 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:01.089458 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell0:SELECT=2 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:01.094005 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ed9b428b-844e-4629-8d55-bc786f1b1840 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16ae5bd700>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:01.123025 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ed9b428b-844e-4629-8d55-bc786f1b1840 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f" status: 200 len: 285 microversion: 2.1 time: 0.034770 Aug 24 09:09:01.123583 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 650/1321] 10.222.0.55 () {58 vars in 1251 bytes} [Wed Aug 24 09:09:01 2022] GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:01.769705 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-595a95c1-da15-4a6e-8143-a8c37f69641e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:01.770345 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-595a95c1-da15-4a6e-8143-a8c37f69641e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:01.776793 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-595a95c1-da15-4a6e-8143-a8c37f69641e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:01.777270 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-595a95c1-da15-4a6e-8143-a8c37f69641e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:01.777699 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-595a95c1-da15-4a6e-8143-a8c37f69641e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:01.778383 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-595a95c1-da15-4a6e-8143-a8c37f69641e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:01.778823 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-595a95c1-da15-4a6e-8143-a8c37f69641e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:01.779237 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-595a95c1-da15-4a6e-8143-a8c37f69641e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:01.916642 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-595a95c1-da15-4a6e-8143-a8c37f69641e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:01.924847 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-595a95c1-da15-4a6e-8143-a8c37f69641e tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1314 microversion: 2.1 time: 0.158978 Aug 24 09:09:01.925407 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 672/1322] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:01 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:02.135966 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-da2cbee6-c34f-49ff-ba46-659a40e66004 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16b2c3e4c0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:02.166934 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-da2cbee6-c34f-49ff-ba46-659a40e66004 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f" status: 200 len: 285 microversion: 2.1 time: 0.035352 Aug 24 09:09:02.167501 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 651/1323] 10.222.0.55 () {58 vars in 1251 bytes} [Wed Aug 24 09:09:02 2022] GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:02.945229 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4fa4e0ee-3c0e-4474-81cc-e4ffe6a103d8 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:02.945870 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4fa4e0ee-3c0e-4474-81cc-e4ffe6a103d8 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:02.953105 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4fa4e0ee-3c0e-4474-81cc-e4ffe6a103d8 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:02.953585 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4fa4e0ee-3c0e-4474-81cc-e4ffe6a103d8 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:02.954011 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4fa4e0ee-3c0e-4474-81cc-e4ffe6a103d8 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:02.954704 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4fa4e0ee-3c0e-4474-81cc-e4ffe6a103d8 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:02.955148 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4fa4e0ee-3c0e-4474-81cc-e4ffe6a103d8 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:02.955564 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4fa4e0ee-3c0e-4474-81cc-e4ffe6a103d8 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:03.085123 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4fa4e0ee-3c0e-4474-81cc-e4ffe6a103d8 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:03.092848 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4fa4e0ee-3c0e-4474-81cc-e4ffe6a103d8 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1314 microversion: 2.1 time: 0.151438 Aug 24 09:09:03.093416 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 673/1324] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:02 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:03.180153 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8b486bbe-4e7a-46a7-89be-265dc7b504d7 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16b2be6e50>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:03.210645 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8b486bbe-4e7a-46a7-89be-265dc7b504d7 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f" status: 200 len: 286 microversion: 2.1 time: 0.034611 Aug 24 09:09:03.211240 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 652/1325] 10.222.0.55 () {58 vars in 1251 bytes} [Wed Aug 24 09:09:03 2022] GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:03.222317 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-19cf0f00-24e9-4650-96c3-5d19987cfcfd tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16ae525790>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:03.290310 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d4d15824-83d3-4fb5-91dd-8de0750a3570 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:03.290826 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d4d15824-83d3-4fb5-91dd-8de0750a3570 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:03.292822 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:03.298344 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d4d15824-83d3-4fb5-91dd-8de0750a3570 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:03.298827 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d4d15824-83d3-4fb5-91dd-8de0750a3570 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:03.299257 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d4d15824-83d3-4fb5-91dd-8de0750a3570 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:03.299943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d4d15824-83d3-4fb5-91dd-8de0750a3570 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:03.300394 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d4d15824-83d3-4fb5-91dd-8de0750a3570 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:03.300846 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d4d15824-83d3-4fb5-91dd-8de0750a3570 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:03.305405 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=89 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:03.314729 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-d4d15824-83d3-4fb5-91dd-8de0750a3570 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] HTTP exception thrown: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d4d15824-83d3-4fb5-91dd-8de0750a3570 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Request method failure captured: Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: DELETE /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a HTTP/1.1 Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeS0VUTeaa4dQaFYAYtjGSAAH8CQ1jkTUMTLWdMuu2xN652lZr9uyUXik2VGDZNXALBwEUuzm5UFU1nuXz6mP8-9mv72c84JmwmibslJ-fUIlh7Z5W7GW54kI9yRPyPC7IqtoG-ZlnuTN8o1RfQh982xowr-0cuefNRE4y8XqTBq_w Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: a69447ca2f314084925442b7f8c9ee2e Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:09:03.316285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:09:03.318015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a69447ca2f314084925442b7f8c9ee2e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:09:03.318015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:09:03.318015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: a69447ca2f314084925442b7f8c9ee2e Aug 24 09:09:03.318015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:09:03.318015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-AttachVolumeShelveTestJSON-1781178415-project Aug 24 09:09:03.318015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:09:03.318015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:09:03.318015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 1105970982014891902ebbb9904a57a5 Aug 24 09:09:03.318015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781178415-project Aug 24 09:09:03.318015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:09:03.318015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:09:03.318015 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': '97fe50f9-e517-4e9a-80b5-6faba0b9f10a'} Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:09:03.319189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:09:03.320726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:03.322321 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d4d15824-83d3-4fb5-91dd-8de0750a3570 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Returning 404 to user: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:09:03.322321 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d4d15824-83d3-4fb5-91dd-8de0750a3570 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "DELETE /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 404 len: 111 microversion: 2.20 time: 0.031571 Aug 24 09:09:03.322321 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 653/1326] 10.222.0.55 () {60 vars in 1280 bytes} [Wed Aug 24 09:09:03 2022] DELETE /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:09:03.326217 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b0463ee0-4ec8-4078-8aa0-fff06fad9639 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:03.326821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b0463ee0-4ec8-4078-8aa0-fff06fad9639 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: 97fe50f9-e517-4e9a-80b5-6faba0b9f10a] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:03.332782 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0463ee0-4ec8-4078-8aa0-fff06fad9639 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:03.333224 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0463ee0-4ec8-4078-8aa0-fff06fad9639 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:03.333648 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0463ee0-4ec8-4078-8aa0-fff06fad9639 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:03.334327 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0463ee0-4ec8-4078-8aa0-fff06fad9639 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:03.334769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0463ee0-4ec8-4078-8aa0-fff06fad9639 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:03.335196 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0463ee0-4ec8-4078-8aa0-fff06fad9639 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:03.350352 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-b0463ee0-4ec8-4078-8aa0-fff06fad9639 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] HTTP exception thrown: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b0463ee0-4ec8-4078-8aa0-fff06fad9639 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Request method failure captured: Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a HTTP/1.1 Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeS0VUTeaa4dQaFYAYtjGSAAH8CQ1jkTUMTLWdMuu2xN652lZr9uyUXik2VGDZNXALBwEUuzm5UFU1nuXz6mP8-9mv72c84JmwmibslJ-fUIlh7Z5W7GW54kI9yRPyPC7IqtoG-ZlnuTN8o1RfQh982xowr-0cuefNRE4y8XqTBq_w Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: a69447ca2f314084925442b7f8c9ee2e Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:09:03.351851 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:09:03.353739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a69447ca2f314084925442b7f8c9ee2e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:09:03.353739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:09:03.353739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: a69447ca2f314084925442b7f8c9ee2e Aug 24 09:09:03.353739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:09:03.353739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-AttachVolumeShelveTestJSON-1781178415-project Aug 24 09:09:03.353739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:09:03.353739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:09:03.353739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 1105970982014891902ebbb9904a57a5 Aug 24 09:09:03.353739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781178415-project Aug 24 09:09:03.353739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:09:03.353739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:09:03.353739 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': '97fe50f9-e517-4e9a-80b5-6faba0b9f10a'} Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:09:03.354769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. Aug 24 09:09:03.356750 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:03.358261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b0463ee0-4ec8-4078-8aa0-fff06fad9639 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Returning 404 to user: Instance 97fe50f9-e517-4e9a-80b5-6faba0b9f10a could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:09:03.358261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b0463ee0-4ec8-4078-8aa0-fff06fad9639 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a" status: 404 len: 111 microversion: 2.20 time: 0.030893 Aug 24 09:09:03.358261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 654/1327] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:09:03 2022] GET /compute/v2.1/servers/97fe50f9-e517-4e9a-80b5-6faba0b9f10a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:09:03.437947 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-19cf0f00-24e9-4650-96c3-5d19987cfcfd tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f" status: 202 len: 0 microversion: 2.1 time: 0.219343 Aug 24 09:09:03.438660 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 674/1328] 10.222.0.55 () {58 vars in 1254 bytes} [Wed Aug 24 09:09:03 2022] DELETE /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:09:03.447230 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-cf4b5ead-1ed6-408c-95ef-ec9741b3b218 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16ae475310>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:03.480892 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-cf4b5ead-1ed6-408c-95ef-ec9741b3b218 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f" status: 200 len: 285 microversion: 2.1 time: 0.037851 Aug 24 09:09:03.481451 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 655/1329] 10.222.0.55 () {58 vars in 1251 bytes} [Wed Aug 24 09:09:03 2022] GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f => generated 285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:04.115480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-4a310aba-b0ca-4326-aaf1-30636ad97fbe tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:04.116090 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-4a310aba-b0ca-4326-aaf1-30636ad97fbe tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:04.122760 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a310aba-b0ca-4326-aaf1-30636ad97fbe tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:04.130369 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a310aba-b0ca-4326-aaf1-30636ad97fbe tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:04.130369 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a310aba-b0ca-4326-aaf1-30636ad97fbe tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:04.130369 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a310aba-b0ca-4326-aaf1-30636ad97fbe tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:04.130369 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a310aba-b0ca-4326-aaf1-30636ad97fbe tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:04.130766 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-4a310aba-b0ca-4326-aaf1-30636ad97fbe tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:04.265265 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-4a310aba-b0ca-4326-aaf1-30636ad97fbe tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:04.273573 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-4a310aba-b0ca-4326-aaf1-30636ad97fbe tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1314 microversion: 2.1 time: 0.163363 Aug 24 09:09:04.274245 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 675/1330] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:04 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:04.494391 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-440d286c-23f6-4e77-974c-03ae3a8cebe9 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16ae5bd670>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:04.531647 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-440d286c-23f6-4e77-974c-03ae3a8cebe9 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] HTTP exception thrown: Snapshot 1210b9e8-843a-4cc1-8324-1135fa666d8f could not be found. Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-440d286c-23f6-4e77-974c-03ae3a8cebe9 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Request method failure captured: Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f HTTP/1.1 Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeqlasfBL8dyQrIKTJeXi8ggAazlbVaQkkQucXK_YLWk6k_482_fwP6JjG0gQjfV5q07TNUGc8EJYkHvIKVPvGK09meMKqWYjlaxed2j-hbyesBTQ24emtkJyVBOs8ex_-9irXPVLzrgGwb6nCPGybCq7y3WKcGxiNI-fLORtVoKNEE Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 02ed9f0eac5849358cf11723e1a51fee Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1584360662 Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:09:04.534141 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:09:04.535808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/02ed9f0eac5849358cf11723e1a51fee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_02ed9f0eac5849358cf11723e1a51fee", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02ed9f0eac5849358cf11723e1a51fee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02ed9f0eac5849358cf11723e1a51fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:09:04.535808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1584360662 Aug 24 09:09:04.535808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 02ed9f0eac5849358cf11723e1a51fee Aug 24 09:09:04.535808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1584360662 Aug 24 09:09:04.535808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-VolumesSnapshotsTestJSON-1584360662-project Aug 24 09:09:04.535808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:09:04.535808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:09:04.535808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: d6bab96f2a6546d9903cf4b57b90780c Aug 24 09:09:04.535808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1584360662-project Aug 24 09:09:04.535808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: Aug 24 09:09:04.535808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Snapshot 1210b9e8-843a-4cc1-8324-1135fa666d8f could not be found. Aug 24 09:09:04.535808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': '1210b9e8-843a-4cc1-8324-1135fa666d8f'} Aug 24 09:09:04.535808 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1210b9e8-843a-4cc1-8324-1135fa666d8f could not be found. (HTTP 404) (Request-ID: req-d7b97a5a-aac1-4b8c-bd6c-04ccc72ac756) Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.537178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 09:09:04.538411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1210b9e8-843a-4cc1-8324-1135fa666d8f could not be found. Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 09:09:04.539629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:09:04.540968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1210b9e8-843a-4cc1-8324-1135fa666d8f could not be found. Aug 24 09:09:04.540968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.540968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:04.540968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.540968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:04.540968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:04.540968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:04.540968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:09:04.540968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:09:04.540968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1210b9e8-843a-4cc1-8324-1135fa666d8f could not be found. Aug 24 09:09:04.540968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.540968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-440d286c-23f6-4e77-974c-03ae3a8cebe9 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Returning 404 to user: Snapshot 1210b9e8-843a-4cc1-8324-1135fa666d8f could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:09:04.540968 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-440d286c-23f6-4e77-974c-03ae3a8cebe9 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f" status: 404 len: 111 microversion: 2.1 time: 0.046145 Aug 24 09:09:04.541857 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 656/1331] 10.222.0.55 () {58 vars in 1251 bytes} [Wed Aug 24 09:09:04 2022] GET /compute/v2.1/os-snapshots/1210b9e8-843a-4cc1-8324-1135fa666d8f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:09:04.546465 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-095d27cc-66b3-4314-9309-76065f9ad962 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16ae77e670>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:04.650963 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e09edb80-e49e-40d6-91f6-42f874f49503 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:04.651454 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e09edb80-e49e-40d6-91f6-42f874f49503 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:04.658218 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e09edb80-e49e-40d6-91f6-42f874f49503 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:04.658698 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e09edb80-e49e-40d6-91f6-42f874f49503 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:04.662425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e09edb80-e49e-40d6-91f6-42f874f49503 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:04.662425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e09edb80-e49e-40d6-91f6-42f874f49503 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:04.662425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e09edb80-e49e-40d6-91f6-42f874f49503 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:04.662425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e09edb80-e49e-40d6-91f6-42f874f49503 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:04.674641 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-e09edb80-e49e-40d6-91f6-42f874f49503 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] HTTP exception thrown: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e09edb80-e49e-40d6-91f6-42f874f49503 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Request method failure captured: Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: DELETE /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 HTTP/1.1 Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeS0VUTeaa4dQaFYAYtjGSAAH8CQ1jkTUMTLWdMuu2xN652lZr9uyUXik2VGDZNXALBwEUuzm5UFU1nuXz6mP8-9mv72c84JmwmibslJ-fUIlh7Z5W7GW54kI9yRPyPC7IqtoG-ZlnuTN8o1RfQh982xowr-0cuefNRE4y8XqTBq_w Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: a69447ca2f314084925442b7f8c9ee2e Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:09:04.676211 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:09:04.677901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a69447ca2f314084925442b7f8c9ee2e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:09:04.677901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:09:04.677901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: a69447ca2f314084925442b7f8c9ee2e Aug 24 09:09:04.677901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:09:04.677901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-AttachVolumeShelveTestJSON-1781178415-project Aug 24 09:09:04.677901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:09:04.677901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:09:04.677901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 1105970982014891902ebbb9904a57a5 Aug 24 09:09:04.677901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781178415-project Aug 24 09:09:04.677901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:09:04.677901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:09:04.677901 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': 'abdb5828-315b-4046-9985-95e58a2f24b3'} Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:09:04.678798 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:09:04.680119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.681428 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e09edb80-e49e-40d6-91f6-42f874f49503 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Returning 404 to user: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:09:04.681428 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e09edb80-e49e-40d6-91f6-42f874f49503 tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "DELETE /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 404 len: 111 microversion: 2.20 time: 0.031562 Aug 24 09:09:04.681428 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 657/1332] 10.222.0.55 () {60 vars in 1280 bytes} [Wed Aug 24 09:09:04 2022] DELETE /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 09:09:04.685859 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-40804b11-979d-45d4-bad5-e0cdaa22099d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:04.686457 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-40804b11-979d-45d4-bad5-e0cdaa22099d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] [instance: abdb5828-315b-4046-9985-95e58a2f24b3] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:04.692364 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-40804b11-979d-45d4-bad5-e0cdaa22099d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:04.692871 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-40804b11-979d-45d4-bad5-e0cdaa22099d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:04.693306 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-40804b11-979d-45d4-bad5-e0cdaa22099d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:04.693984 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-40804b11-979d-45d4-bad5-e0cdaa22099d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:04.694434 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-40804b11-979d-45d4-bad5-e0cdaa22099d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:04.694855 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-40804b11-979d-45d4-bad5-e0cdaa22099d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:04.709772 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-40804b11-979d-45d4-bad5-e0cdaa22099d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] HTTP exception thrown: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-40804b11-979d-45d4-bad5-e0cdaa22099d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Request method failure captured: Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 HTTP/1.1 Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeeS0VUTeaa4dQaFYAYtjGSAAH8CQ1jkTUMTLWdMuu2xN652lZr9uyUXik2VGDZNXALBwEUuzm5UFU1nuXz6mP8-9mv72c84JmwmibslJ-fUIlh7Z5W7GW54kI9yRPyPC7IqtoG-ZlnuTN8o1RfQh982xowr-0cuefNRE4y8XqTBq_w Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: a69447ca2f314084925442b7f8c9ee2e Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:09:04.712579 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:09:04.714311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a69447ca2f314084925442b7f8c9ee2e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a69447ca2f314084925442b7f8c9ee2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:09:04.714311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:09:04.714311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: a69447ca2f314084925442b7f8c9ee2e Aug 24 09:09:04.714311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781178415 Aug 24 09:09:04.714311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-AttachVolumeShelveTestJSON-1781178415-project Aug 24 09:09:04.714311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:09:04.714311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:09:04.714311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 1105970982014891902ebbb9904a57a5 Aug 24 09:09:04.714311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781178415-project Aug 24 09:09:04.714311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:09:04.714311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:09:04.714311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': 'abdb5828-315b-4046-9985-95e58a2f24b3'} Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:09:04.715465 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. Aug 24 09:09:04.717535 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:04.718973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-40804b11-979d-45d4-bad5-e0cdaa22099d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] Returning 404 to user: Instance abdb5828-315b-4046-9985-95e58a2f24b3 could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:09:04.718973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-40804b11-979d-45d4-bad5-e0cdaa22099d tempest-AttachVolumeShelveTestJSON-1781178415 tempest-AttachVolumeShelveTestJSON-1781178415-project] 10.222.0.55 "GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3" status: 404 len: 111 microversion: 2.20 time: 0.031864 Aug 24 09:09:04.718973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 658/1333] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Aug 24 09:09:04 2022] GET /compute/v2.1/servers/abdb5828-315b-4046-9985-95e58a2f24b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 09:09:04.732139 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-095d27cc-66b3-4314-9309-76065f9ad962 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621" status: 202 len: 0 microversion: 2.1 time: 0.186362 Aug 24 09:09:04.732139 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 676/1334] 10.222.0.55 () {58 vars in 1248 bytes} [Wed Aug 24 09:09:04 2022] DELETE /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:09:04.741423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-072e72b1-da97-48e6-ad36-d29899d92483 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16ae4951f0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:04.801415 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-072e72b1-da97-48e6-ad36-d29899d92483 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621" status: 200 len: 344 microversion: 2.1 time: 0.065542 Aug 24 09:09:04.801939 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 659/1335] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 09:09:04 2022] GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:05.296710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a9c90acb-587a-4fd6-867a-793d33c8c1f3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:05.297334 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a9c90acb-587a-4fd6-867a-793d33c8c1f3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:05.303413 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9c90acb-587a-4fd6-867a-793d33c8c1f3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:05.303896 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9c90acb-587a-4fd6-867a-793d33c8c1f3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:05.304327 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9c90acb-587a-4fd6-867a-793d33c8c1f3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:05.305104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9c90acb-587a-4fd6-867a-793d33c8c1f3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:05.305554 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9c90acb-587a-4fd6-867a-793d33c8c1f3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:05.305971 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a9c90acb-587a-4fd6-867a-793d33c8c1f3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:05.540289 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a9c90acb-587a-4fd6-867a-793d33c8c1f3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:05.563370 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a9c90acb-587a-4fd6-867a-793d33c8c1f3 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1314 microversion: 2.1 time: 0.257776 Aug 24 09:09:05.563370 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 677/1336] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:05 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:05.815947 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c723bbc1-efa9-4ebe-a4a9-6ebc9d3b0591 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16ae4d39d0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:05.846912 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-c723bbc1-efa9-4ebe-a4a9-6ebc9d3b0591 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] HTTP exception thrown: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c723bbc1-efa9-4ebe-a4a9-6ebc9d3b0591 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Request method failure captured: Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621 HTTP/1.1 Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeqlasfBL8dyQrIKTJeXi8ggAazlbVaQkkQucXK_YLWk6k_482_fwP6JjG0gQjfV5q07TNUGc8EJYkHvIKVPvGK09meMKqWYjlaxed2j-hbyesBTQ24emtkJyVBOs8ex_-9irXPVLzrgGwb6nCPGybCq7y3WKcGxiNI-fLORtVoKNEE Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 02ed9f0eac5849358cf11723e1a51fee Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1584360662 Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:09:05.849802 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:09:05.855150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/02ed9f0eac5849358cf11723e1a51fee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_02ed9f0eac5849358cf11723e1a51fee", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02ed9f0eac5849358cf11723e1a51fee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02ed9f0eac5849358cf11723e1a51fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:09:05.855150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1584360662 Aug 24 09:09:05.855150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 02ed9f0eac5849358cf11723e1a51fee Aug 24 09:09:05.855150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1584360662 Aug 24 09:09:05.855150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-VolumesSnapshotsTestJSON-1584360662-project Aug 24 09:09:05.855150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:09:05.855150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:09:05.855150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: d6bab96f2a6546d9903cf4b57b90780c Aug 24 09:09:05.855150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1584360662-project Aug 24 09:09:05.855150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: Aug 24 09:09:05.855150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.855150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': 'c96ed941-3896-4428-a8ae-882a4673d621'} Aug 24 09:09:05.855150 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. (HTTP 404) (Request-ID: req-13f61deb-7495-4872-a4d8-8f9fde7051cf) Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:05.856059 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 09:09:05.857864 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 09:09:05.859043 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-c723bbc1-efa9-4ebe-a4a9-6ebc9d3b0591 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Returning 404 to user: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-c723bbc1-efa9-4ebe-a4a9-6ebc9d3b0591 tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621" status: 404 len: 109 microversion: 2.1 time: 0.039611 Aug 24 09:09:05.860235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 660/1337] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 09:09:05 2022] GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:09:05.866340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b50ff7d2-420f-4bdf-aacf-8fbbca10ba1e tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16b2ae91f0>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:05.895360 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-b50ff7d2-420f-4bdf-aacf-8fbbca10ba1e tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] HTTP exception thrown: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b50ff7d2-420f-4bdf-aacf-8fbbca10ba1e tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Request method failure captured: Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: DELETE /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621 HTTP/1.1 Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeqlasfBL8dyQrIKTJeXi8ggAazlbVaQkkQucXK_YLWk6k_482_fwP6JjG0gQjfV5q07TNUGc8EJYkHvIKVPvGK09meMKqWYjlaxed2j-hbyesBTQ24emtkJyVBOs8ex_-9irXPVLzrgGwb6nCPGybCq7y3WKcGxiNI-fLORtVoKNEE Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 02ed9f0eac5849358cf11723e1a51fee Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1584360662 Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:09:05.896934 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:09:05.898541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/02ed9f0eac5849358cf11723e1a51fee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_02ed9f0eac5849358cf11723e1a51fee", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02ed9f0eac5849358cf11723e1a51fee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02ed9f0eac5849358cf11723e1a51fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:09:05.898541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1584360662 Aug 24 09:09:05.898541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 02ed9f0eac5849358cf11723e1a51fee Aug 24 09:09:05.898541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1584360662 Aug 24 09:09:05.898541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-VolumesSnapshotsTestJSON-1584360662-project Aug 24 09:09:05.898541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:09:05.898541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:09:05.898541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: d6bab96f2a6546d9903cf4b57b90780c Aug 24 09:09:05.898541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1584360662-project Aug 24 09:09:05.898541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: Aug 24 09:09:05.898541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.898541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': 'c96ed941-3896-4428-a8ae-882a4673d621'} Aug 24 09:09:05.898541 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. (HTTP 404) (Request-ID: req-7a297531-6684-4912-a5f7-3f8722e081a5) Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:05.899382 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 09:09:05.900864 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 09:09:05.902853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:09:05.905940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.905940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.905940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:05.905940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.905940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:05.905940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:05.905940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:05.905940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:09:05.905940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:09:05.905940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.905940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.905940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b50ff7d2-420f-4bdf-aacf-8fbbca10ba1e tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Returning 404 to user: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:09:05.905940 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b50ff7d2-420f-4bdf-aacf-8fbbca10ba1e tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621" status: 404 len: 109 microversion: 2.1 time: 0.036035 Aug 24 09:09:05.907632 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 678/1338] 10.222.0.55 () {58 vars in 1248 bytes} [Wed Aug 24 09:09:05 2022] DELETE /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:09:05.908741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9234b5ef-4cf3-4384-8825-5cc60fca1a2f tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Calling method '.version_select at 0x7f16ae4951f0>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:05.937768 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-9234b5ef-4cf3-4384-8825-5cc60fca1a2f tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] HTTP exception thrown: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9234b5ef-4cf3-4384-8825-5cc60fca1a2f tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Request method failure captured: Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621 HTTP/1.1 Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeqlasfBL8dyQrIKTJeXi8ggAazlbVaQkkQucXK_YLWk6k_482_fwP6JjG0gQjfV5q07TNUGc8EJYkHvIKVPvGK09meMKqWYjlaxed2j-hbyesBTQ24emtkJyVBOs8ex_-9irXPVLzrgGwb6nCPGybCq7y3WKcGxiNI-fLORtVoKNEE Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 02ed9f0eac5849358cf11723e1a51fee Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1584360662 Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:09:05.945987 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:09:05.947505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/02ed9f0eac5849358cf11723e1a51fee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_02ed9f0eac5849358cf11723e1a51fee", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02ed9f0eac5849358cf11723e1a51fee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/02ed9f0eac5849358cf11723e1a51fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:09:05.947505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1584360662 Aug 24 09:09:05.947505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 02ed9f0eac5849358cf11723e1a51fee Aug 24 09:09:05.947505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1584360662 Aug 24 09:09:05.947505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-VolumesSnapshotsTestJSON-1584360662-project Aug 24 09:09:05.947505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:09:05.947505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:09:05.947505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: d6bab96f2a6546d9903cf4b57b90780c Aug 24 09:09:05.947505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1584360662-project Aug 24 09:09:05.947505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: Aug 24 09:09:05.947505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.947505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': 'c96ed941-3896-4428-a8ae-882a4673d621'} Aug 24 09:09:05.947505 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. (HTTP 404) (Request-ID: req-62548801-8b57-45f5-861d-1fdf101317fb) Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:05.948425 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 09:09:05.950123 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 09:09:05.951728 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-9234b5ef-4cf3-4384-8825-5cc60fca1a2f tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] Returning 404 to user: Volume c96ed941-3896-4428-a8ae-882a4673d621 could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-9234b5ef-4cf3-4384-8825-5cc60fca1a2f tempest-VolumesSnapshotsTestJSON-1584360662 tempest-VolumesSnapshotsTestJSON-1584360662-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621" status: 404 len: 109 microversion: 2.1 time: 0.045254 Aug 24 09:09:05.954165 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 661/1339] 10.222.0.55 () {58 vars in 1245 bytes} [Wed Aug 24 09:09:05 2022] GET /compute/v2.1/os-volumes/c96ed941-3896-4428-a8ae-882a4673d621 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:09:06.570702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e7d34087-b094-4d26-9ef8-ed36e8f76c0f tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:06.573898 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e7d34087-b094-4d26-9ef8-ed36e8f76c0f tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:06.579607 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e7d34087-b094-4d26-9ef8-ed36e8f76c0f tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:06.580314 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e7d34087-b094-4d26-9ef8-ed36e8f76c0f tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:06.580937 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e7d34087-b094-4d26-9ef8-ed36e8f76c0f tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:06.581944 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e7d34087-b094-4d26-9ef8-ed36e8f76c0f tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:06.582599 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e7d34087-b094-4d26-9ef8-ed36e8f76c0f tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:06.583021 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e7d34087-b094-4d26-9ef8-ed36e8f76c0f tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:07.033682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e7d34087-b094-4d26-9ef8-ed36e8f76c0f tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:07.042004 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e7d34087-b094-4d26-9ef8-ed36e8f76c0f tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1314 microversion: 2.1 time: 0.475043 Aug 24 09:09:07.046442 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 679/1340] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:06 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:07.360011 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-3809c4f3-300e-489c-81ed-55df5170b51b req-fb78da2c-d91f-482c-877f-5c4af8c0bf31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfca5034-37c3-48af-9404-0f54934b89c2", "name": "network-vif-plugged", "status": "completed", "tag": "9885771e-35df-45c2-b301-b0d71c55b1c0"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:07.380169 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-3809c4f3-300e-489c-81ed-55df5170b51b req-fb78da2c-d91f-482c-877f-5c4af8c0bf31 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:07.380959 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-3809c4f3-300e-489c-81ed-55df5170b51b req-fb78da2c-d91f-482c-877f-5c4af8c0bf31 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:07.381597 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-3809c4f3-300e-489c-81ed-55df5170b51b req-fb78da2c-d91f-482c-877f-5c4af8c0bf31 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:07.394780 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-3809c4f3-300e-489c-81ed-55df5170b51b req-fb78da2c-d91f-482c-877f-5c4af8c0bf31 service nova] Creating event network-vif-plugged:9885771e-35df-45c2-b301-b0d71c55b1c0 for instance bfca5034-37c3-48af-9404-0f54934b89c2 on hv-cinder-85221 Aug 24 09:09:07.402227 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-3809c4f3-300e-489c-81ed-55df5170b51b req-fb78da2c-d91f-482c-877f-5c4af8c0bf31 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047892 Aug 24 09:09:07.404745 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 662/1341] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:08.070386 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3a5470f1-fb4e-4235-81a0-53a6c165cbaf tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:08.071361 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3a5470f1-fb4e-4235-81a0-53a6c165cbaf tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:08.085042 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3a5470f1-fb4e-4235-81a0-53a6c165cbaf tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:08.085658 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3a5470f1-fb4e-4235-81a0-53a6c165cbaf tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:08.086124 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3a5470f1-fb4e-4235-81a0-53a6c165cbaf tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:08.086834 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3a5470f1-fb4e-4235-81a0-53a6c165cbaf tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:08.087281 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3a5470f1-fb4e-4235-81a0-53a6c165cbaf tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:08.087703 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3a5470f1-fb4e-4235-81a0-53a6c165cbaf tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:08.235793 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3a5470f1-fb4e-4235-81a0-53a6c165cbaf tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:08.244192 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3a5470f1-fb4e-4235-81a0-53a6c165cbaf tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1314 microversion: 2.1 time: 0.184318 Aug 24 09:09:08.244887 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 680/1342] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:08 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:09.266010 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-386a09d0-7fad-449e-a787-ca0cf6180932 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:09.266742 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-386a09d0-7fad-449e-a787-ca0cf6180932 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:09.273357 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-386a09d0-7fad-449e-a787-ca0cf6180932 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:09.273893 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-386a09d0-7fad-449e-a787-ca0cf6180932 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:09.274328 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-386a09d0-7fad-449e-a787-ca0cf6180932 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:09.275018 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-386a09d0-7fad-449e-a787-ca0cf6180932 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:09.275468 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-386a09d0-7fad-449e-a787-ca0cf6180932 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:09.275890 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-386a09d0-7fad-449e-a787-ca0cf6180932 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:09.409528 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-386a09d0-7fad-449e-a787-ca0cf6180932 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:09.417689 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-386a09d0-7fad-449e-a787-ca0cf6180932 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1314 microversion: 2.1 time: 0.155820 Aug 24 09:09:09.418463 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 663/1343] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:09 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:10.444753 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-54062368-2641-4ae6-9d75-eac9ee8040fb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:10.445972 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-54062368-2641-4ae6-9d75-eac9ee8040fb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:10.453441 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-54062368-2641-4ae6-9d75-eac9ee8040fb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:10.453942 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-54062368-2641-4ae6-9d75-eac9ee8040fb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:10.454363 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-54062368-2641-4ae6-9d75-eac9ee8040fb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:10.455063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-54062368-2641-4ae6-9d75-eac9ee8040fb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:10.455689 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-54062368-2641-4ae6-9d75-eac9ee8040fb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:10.456284 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-54062368-2641-4ae6-9d75-eac9ee8040fb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:10.592771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-54062368-2641-4ae6-9d75-eac9ee8040fb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:10.599997 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-54062368-2641-4ae6-9d75-eac9ee8040fb tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1463 microversion: 2.1 time: 0.158420 Aug 24 09:09:10.599997 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 681/1344] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:10 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:10.645815 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-db159259-8640-44e0-8ca0-ad469ca473c1 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:10.646324 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-db159259-8640-44e0-8ca0-ad469ca473c1 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:10.652994 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-db159259-8640-44e0-8ca0-ad469ca473c1 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:10.653460 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-db159259-8640-44e0-8ca0-ad469ca473c1 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:10.654101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-db159259-8640-44e0-8ca0-ad469ca473c1 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:10.654804 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-db159259-8640-44e0-8ca0-ad469ca473c1 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:10.655310 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-db159259-8640-44e0-8ca0-ad469ca473c1 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:10.655732 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-db159259-8640-44e0-8ca0-ad469ca473c1 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:10.682199 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-db159259-8640-44e0-8ca0-ad469ca473c1 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Going to try to terminate instance {{(pid=132985) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:09:11.070560 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-db159259-8640-44e0-8ca0-ad469ca473c1 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "DELETE /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 204 len: 0 microversion: 2.1 time: 0.428314 Aug 24 09:09:11.071325 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 664/1345] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:09:10 2022] DELETE /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:09:11.083009 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b64a2a15-7a26-490d-8626-0bd7ba116818 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:11.083009 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b64a2a15-7a26-490d-8626-0bd7ba116818 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:11.086868 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b64a2a15-7a26-490d-8626-0bd7ba116818 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:11.087381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b64a2a15-7a26-490d-8626-0bd7ba116818 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:11.087814 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b64a2a15-7a26-490d-8626-0bd7ba116818 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:11.088499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b64a2a15-7a26-490d-8626-0bd7ba116818 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:11.089013 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b64a2a15-7a26-490d-8626-0bd7ba116818 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:11.089432 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b64a2a15-7a26-490d-8626-0bd7ba116818 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:11.226697 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b64a2a15-7a26-490d-8626-0bd7ba116818 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:11.235429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b64a2a15-7a26-490d-8626-0bd7ba116818 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1469 microversion: 2.1 time: 0.159546 Aug 24 09:09:11.235995 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 682/1346] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:11 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:12.256472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-72614f93-9718-4490-b18f-cca4daf6df9d tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:12.257202 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-72614f93-9718-4490-b18f-cca4daf6df9d tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:12.263943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-72614f93-9718-4490-b18f-cca4daf6df9d tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:12.264421 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-72614f93-9718-4490-b18f-cca4daf6df9d tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:12.264885 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-72614f93-9718-4490-b18f-cca4daf6df9d tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:12.265578 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-72614f93-9718-4490-b18f-cca4daf6df9d tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:12.266026 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-72614f93-9718-4490-b18f-cca4daf6df9d tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:12.266444 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-72614f93-9718-4490-b18f-cca4daf6df9d tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:12.403532 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-72614f93-9718-4490-b18f-cca4daf6df9d tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:12.412314 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-72614f93-9718-4490-b18f-cca4daf6df9d tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1469 microversion: 2.1 time: 0.160044 Aug 24 09:09:12.412912 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 665/1347] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:12 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:13.433771 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0ce8a17a-10d4-4b4c-a075-d2718857f470 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:13.434743 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0ce8a17a-10d4-4b4c-a075-d2718857f470 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:13.441912 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0ce8a17a-10d4-4b4c-a075-d2718857f470 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:13.442391 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0ce8a17a-10d4-4b4c-a075-d2718857f470 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:13.442826 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0ce8a17a-10d4-4b4c-a075-d2718857f470 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:13.443508 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0ce8a17a-10d4-4b4c-a075-d2718857f470 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:13.443951 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0ce8a17a-10d4-4b4c-a075-d2718857f470 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:13.444366 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0ce8a17a-10d4-4b4c-a075-d2718857f470 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:13.522993 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0ce8a17a-10d4-4b4c-a075-d2718857f470 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:13.532429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0ce8a17a-10d4-4b4c-a075-d2718857f470 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1427 microversion: 2.1 time: 0.102427 Aug 24 09:09:13.534261 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 683/1348] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:13 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:13.573605 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-1de1ac52-b7d9-4700-9d43-8cde8ee172d1 req-22d29599-8216-4311-bcf8-ba028656280f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfca5034-37c3-48af-9404-0f54934b89c2", "name": "network-vif-deleted", "tag": "9885771e-35df-45c2-b301-b0d71c55b1c0"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:13.584590 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-1de1ac52-b7d9-4700-9d43-8cde8ee172d1 req-22d29599-8216-4311-bcf8-ba028656280f service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:13.588337 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-1de1ac52-b7d9-4700-9d43-8cde8ee172d1 req-22d29599-8216-4311-bcf8-ba028656280f service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:13.588337 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-1de1ac52-b7d9-4700-9d43-8cde8ee172d1 req-22d29599-8216-4311-bcf8-ba028656280f service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:13.597569 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-1de1ac52-b7d9-4700-9d43-8cde8ee172d1 req-22d29599-8216-4311-bcf8-ba028656280f service nova] Creating event network-vif-deleted:9885771e-35df-45c2-b301-b0d71c55b1c0 for instance bfca5034-37c3-48af-9404-0f54934b89c2 on hv-cinder-85221 Aug 24 09:09:13.602588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-1de1ac52-b7d9-4700-9d43-8cde8ee172d1 req-22d29599-8216-4311-bcf8-ba028656280f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032805 Aug 24 09:09:13.603483 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 666/1349] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:14.555136 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:14.555733 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:14.562818 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:14.563289 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:14.563712 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:14.564389 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:14.564873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:14.565332 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:14.607844 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:14.608866 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:14.609310 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:14.609844 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lazy-loading 'fault' on Instance uuid bfca5034-37c3-48af-9404-0f54934b89c2 {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:09:14.613392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=100 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:14.661275 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c030e83e1cc40609d901de3ed82a90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccb7b3c5c2844eb84a115fa60b186ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:14.671785 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1d6fb7e4-c40e-4fe8-8fba-d357af21a369 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 200 len: 1304 microversion: 2.1 time: 0.119624 Aug 24 09:09:14.672399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 684/1350] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:14 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:15.700398 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-da873703-76fc-4d7f-bd4c-3e083f138098 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:15.700398 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-da873703-76fc-4d7f-bd4c-3e083f138098 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] [instance: bfca5034-37c3-48af-9404-0f54934b89c2] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:15.710853 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-da873703-76fc-4d7f-bd4c-3e083f138098 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:15.711459 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-da873703-76fc-4d7f-bd4c-3e083f138098 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:15.711990 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-da873703-76fc-4d7f-bd4c-3e083f138098 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:15.712792 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-da873703-76fc-4d7f-bd4c-3e083f138098 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:15.713336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-da873703-76fc-4d7f-bd4c-3e083f138098 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:15.713858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-da873703-76fc-4d7f-bd4c-3e083f138098 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:15.728801 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-da873703-76fc-4d7f-bd4c-3e083f138098 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] HTTP exception thrown: Instance bfca5034-37c3-48af-9404-0f54934b89c2 could not be found. Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-da873703-76fc-4d7f-bd4c-3e083f138098 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Request method failure captured: Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 HTTP/1.1 Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeqeXVikTqKykyp3c6Rqc_Ttz6baLHv66ppS7TZlvzxCEodaqM38vp9lC0O8Z3Urj4k2KhoIhqrsREo_ZbKuusroZsNXhWYCCJTJ_wDNK3BLQOyEn52TNRHLLGf02E6Lk4ne4EOCFnM-UJ3Y7DthBp2dSGdB2Gc8aq2V6DUGIeSueRM Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: bccb7b3c5c2844eb84a115fa60b186ff Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-VolumesNegativeTest-896073752 Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:09:15.731077 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:09:15.733309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bccb7b3c5c2844eb84a115fa60b186ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bccb7b3c5c2844eb84a115fa60b186ff", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bccb7b3c5c2844eb84a115fa60b186ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bccb7b3c5c2844eb84a115fa60b186ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:09:15.733309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-VolumesNegativeTest-896073752 Aug 24 09:09:15.733309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: bccb7b3c5c2844eb84a115fa60b186ff Aug 24 09:09:15.733309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-VolumesNegativeTest-896073752 Aug 24 09:09:15.733309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-VolumesNegativeTest-896073752-project Aug 24 09:09:15.733309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:09:15.733309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:09:15.733309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: 5c030e83e1cc40609d901de3ed82a90e Aug 24 09:09:15.733309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-VolumesNegativeTest-896073752-project Aug 24 09:09:15.733309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:09:15.733309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance bfca5034-37c3-48af-9404-0f54934b89c2 could not be found. Aug 24 09:09:15.733309 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': 'bfca5034-37c3-48af-9404-0f54934b89c2'} Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfca5034-37c3-48af-9404-0f54934b89c2 could not be found. Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:09:15.734423 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfca5034-37c3-48af-9404-0f54934b89c2 could not be found. Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfca5034-37c3-48af-9404-0f54934b89c2 could not be found. Aug 24 09:09:15.736445 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:09:15.738402 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-da873703-76fc-4d7f-bd4c-3e083f138098 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] Returning 404 to user: Instance bfca5034-37c3-48af-9404-0f54934b89c2 could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:09:15.738402 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-da873703-76fc-4d7f-bd4c-3e083f138098 tempest-VolumesNegativeTest-896073752 tempest-VolumesNegativeTest-896073752-project] 10.222.0.55 "GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2" status: 404 len: 111 microversion: 2.1 time: 0.039001 Aug 24 09:09:15.738402 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 667/1351] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:15 2022] GET /compute/v2.1/servers/bfca5034-37c3-48af-9404-0f54934b89c2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:09:31.921973 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-bf641d97-88ef-4e49-b9fd-16480b022a32 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:31.922487 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-bf641d97-88ef-4e49-b9fd-16480b022a32 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:31.924511 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=25 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:31.929921 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bf641d97-88ef-4e49-b9fd-16480b022a32 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:31.930409 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bf641d97-88ef-4e49-b9fd-16480b022a32 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:31.930839 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bf641d97-88ef-4e49-b9fd-16480b022a32 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:31.931649 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bf641d97-88ef-4e49-b9fd-16480b022a32 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:31.932099 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bf641d97-88ef-4e49-b9fd-16480b022a32 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:31.932524 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-bf641d97-88ef-4e49-b9fd-16480b022a32 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:31.956328 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-bf641d97-88ef-4e49-b9fd-16480b022a32 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lazy-loading 'flavor' on Instance uuid 35d117b5-1850-4c20-9c32-177d76a0f5bb {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:09:32.252984 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-bf641d97-88ef-4e49-b9fd-16480b022a32 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "POST /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb/action" status: 202 len: 0 microversion: 2.1 time: 0.335398 Aug 24 09:09:32.253597 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 685/1352] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 09:09:31 2022] POST /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:09:32.263817 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-997c92af-3ef7-4827-8ab1-70129e64b683 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:32.264558 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-997c92af-3ef7-4827-8ab1-70129e64b683 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:32.269319 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:32.270064 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:32.274021 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-997c92af-3ef7-4827-8ab1-70129e64b683 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:32.274588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-997c92af-3ef7-4827-8ab1-70129e64b683 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:32.275084 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-997c92af-3ef7-4827-8ab1-70129e64b683 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:32.275877 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-997c92af-3ef7-4827-8ab1-70129e64b683 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:32.276393 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-997c92af-3ef7-4827-8ab1-70129e64b683 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:32.276909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-997c92af-3ef7-4827-8ab1-70129e64b683 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:32.420662 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-997c92af-3ef7-4827-8ab1-70129e64b683 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:32.428299 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-997c92af-3ef7-4827-8ab1-70129e64b683 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.170061 Aug 24 09:09:32.428886 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 668/1353] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:32 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:33.449829 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-904c97f6-c24c-4c41-a855-9fa98455cecd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:33.450538 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-904c97f6-c24c-4c41-a855-9fa98455cecd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:33.456898 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-904c97f6-c24c-4c41-a855-9fa98455cecd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:33.457381 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-904c97f6-c24c-4c41-a855-9fa98455cecd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:33.457816 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-904c97f6-c24c-4c41-a855-9fa98455cecd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:33.458500 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-904c97f6-c24c-4c41-a855-9fa98455cecd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:33.458949 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-904c97f6-c24c-4c41-a855-9fa98455cecd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:33.459371 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-904c97f6-c24c-4c41-a855-9fa98455cecd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:33.598588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-904c97f6-c24c-4c41-a855-9fa98455cecd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:33.606698 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-904c97f6-c24c-4c41-a855-9fa98455cecd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.161655 Aug 24 09:09:33.607277 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 686/1354] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:33 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:34.628612 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-d62b5853-3e57-477e-90eb-698f094a6d15 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:34.629283 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-d62b5853-3e57-477e-90eb-698f094a6d15 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:34.636439 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d62b5853-3e57-477e-90eb-698f094a6d15 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:34.636958 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d62b5853-3e57-477e-90eb-698f094a6d15 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:34.637387 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d62b5853-3e57-477e-90eb-698f094a6d15 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:34.638079 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d62b5853-3e57-477e-90eb-698f094a6d15 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:34.638520 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d62b5853-3e57-477e-90eb-698f094a6d15 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:34.638933 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-d62b5853-3e57-477e-90eb-698f094a6d15 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:34.777681 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-d62b5853-3e57-477e-90eb-698f094a6d15 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:34.786099 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-d62b5853-3e57-477e-90eb-698f094a6d15 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.162704 Aug 24 09:09:34.786925 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 669/1355] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:34 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:09:35.810122 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-09c294f4-d342-4b57-bb50-8b3da4ca9bc8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:35.810787 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-09c294f4-d342-4b57-bb50-8b3da4ca9bc8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:35.817728 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-09c294f4-d342-4b57-bb50-8b3da4ca9bc8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:35.818201 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-09c294f4-d342-4b57-bb50-8b3da4ca9bc8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:35.818636 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-09c294f4-d342-4b57-bb50-8b3da4ca9bc8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:35.819317 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-09c294f4-d342-4b57-bb50-8b3da4ca9bc8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:35.819763 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-09c294f4-d342-4b57-bb50-8b3da4ca9bc8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:35.820212 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-09c294f4-d342-4b57-bb50-8b3da4ca9bc8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:35.955397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-09c294f4-d342-4b57-bb50-8b3da4ca9bc8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:35.963519 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-09c294f4-d342-4b57-bb50-8b3da4ca9bc8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.157977 Aug 24 09:09:35.964160 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 687/1356] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:35 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:36.984567 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3986ad89-495a-4d52-981e-c8582b3f7615 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:36.985183 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3986ad89-495a-4d52-981e-c8582b3f7615 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:36.991451 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3986ad89-495a-4d52-981e-c8582b3f7615 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:36.991927 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3986ad89-495a-4d52-981e-c8582b3f7615 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:36.992351 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3986ad89-495a-4d52-981e-c8582b3f7615 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:36.993067 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3986ad89-495a-4d52-981e-c8582b3f7615 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:36.993518 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3986ad89-495a-4d52-981e-c8582b3f7615 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:36.993933 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3986ad89-495a-4d52-981e-c8582b3f7615 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:37.138740 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3986ad89-495a-4d52-981e-c8582b3f7615 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:37.151776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3986ad89-495a-4d52-981e-c8582b3f7615 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.171098 Aug 24 09:09:37.152740 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 670/1357] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:36 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:38.173297 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-0843652e-fed7-43fd-9100-3904db1829b7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:38.173926 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-0843652e-fed7-43fd-9100-3904db1829b7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:38.180180 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0843652e-fed7-43fd-9100-3904db1829b7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:38.180674 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0843652e-fed7-43fd-9100-3904db1829b7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:38.181106 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0843652e-fed7-43fd-9100-3904db1829b7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:38.181785 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0843652e-fed7-43fd-9100-3904db1829b7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:38.182239 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0843652e-fed7-43fd-9100-3904db1829b7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:38.182654 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-0843652e-fed7-43fd-9100-3904db1829b7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:38.323118 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-0843652e-fed7-43fd-9100-3904db1829b7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:38.331816 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-0843652e-fed7-43fd-9100-3904db1829b7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.162345 Aug 24 09:09:38.333163 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 688/1358] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:38 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:39.361825 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-80204bc3-91cc-4df1-804e-c282d01cbdbb tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:39.362417 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-80204bc3-91cc-4df1-804e-c282d01cbdbb tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:39.369336 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-80204bc3-91cc-4df1-804e-c282d01cbdbb tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:39.369842 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-80204bc3-91cc-4df1-804e-c282d01cbdbb tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:39.370228 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-80204bc3-91cc-4df1-804e-c282d01cbdbb tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:39.370909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-80204bc3-91cc-4df1-804e-c282d01cbdbb tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:39.371368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-80204bc3-91cc-4df1-804e-c282d01cbdbb tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:39.371762 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-80204bc3-91cc-4df1-804e-c282d01cbdbb tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:39.500329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-80204bc3-91cc-4df1-804e-c282d01cbdbb tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:39.508284 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-80204bc3-91cc-4df1-804e-c282d01cbdbb tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.150269 Aug 24 09:09:39.508890 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 671/1359] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:39 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:40.530831 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5c52e9e4-4b67-407d-a757-848c8d7fdce7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:40.531645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5c52e9e4-4b67-407d-a757-848c8d7fdce7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:40.538210 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5c52e9e4-4b67-407d-a757-848c8d7fdce7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:40.538681 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5c52e9e4-4b67-407d-a757-848c8d7fdce7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:40.539104 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5c52e9e4-4b67-407d-a757-848c8d7fdce7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:40.539783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5c52e9e4-4b67-407d-a757-848c8d7fdce7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:40.540224 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5c52e9e4-4b67-407d-a757-848c8d7fdce7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:40.540663 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5c52e9e4-4b67-407d-a757-848c8d7fdce7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:40.671767 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5c52e9e4-4b67-407d-a757-848c8d7fdce7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:40.680593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5c52e9e4-4b67-407d-a757-848c8d7fdce7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.154447 Aug 24 09:09:40.681200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 689/1360] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:40 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:41.701793 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-90c88946-0ea9-4de0-994d-3e86c3cd6de8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:41.702402 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-90c88946-0ea9-4de0-994d-3e86c3cd6de8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:41.709859 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-90c88946-0ea9-4de0-994d-3e86c3cd6de8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:41.710430 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-90c88946-0ea9-4de0-994d-3e86c3cd6de8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:41.710991 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-90c88946-0ea9-4de0-994d-3e86c3cd6de8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:41.711889 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-90c88946-0ea9-4de0-994d-3e86c3cd6de8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:41.712416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-90c88946-0ea9-4de0-994d-3e86c3cd6de8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:41.712951 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-90c88946-0ea9-4de0-994d-3e86c3cd6de8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:41.849515 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-90c88946-0ea9-4de0-994d-3e86c3cd6de8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:41.857524 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-90c88946-0ea9-4de0-994d-3e86c3cd6de8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.159442 Aug 24 09:09:41.857926 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 672/1361] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:41 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:42.878987 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-f3c87891-82e6-4b1d-bf8e-085daf4e81d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:42.880217 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-f3c87891-82e6-4b1d-bf8e-085daf4e81d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:42.886865 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3c87891-82e6-4b1d-bf8e-085daf4e81d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:42.887345 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3c87891-82e6-4b1d-bf8e-085daf4e81d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:42.887781 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3c87891-82e6-4b1d-bf8e-085daf4e81d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:42.888480 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3c87891-82e6-4b1d-bf8e-085daf4e81d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:42.888960 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3c87891-82e6-4b1d-bf8e-085daf4e81d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:42.889415 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-f3c87891-82e6-4b1d-bf8e-085daf4e81d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:43.032668 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-f3c87891-82e6-4b1d-bf8e-085daf4e81d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:43.042645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-f3c87891-82e6-4b1d-bf8e-085daf4e81d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.167500 Aug 24 09:09:43.043355 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 690/1362] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:42 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:44.065560 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2c1701a0-653c-491f-859f-1e5c958679f2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:44.066164 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2c1701a0-653c-491f-859f-1e5c958679f2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:44.073468 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c1701a0-653c-491f-859f-1e5c958679f2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:44.073976 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c1701a0-653c-491f-859f-1e5c958679f2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:44.074365 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c1701a0-653c-491f-859f-1e5c958679f2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:44.075057 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c1701a0-653c-491f-859f-1e5c958679f2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:44.075626 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c1701a0-653c-491f-859f-1e5c958679f2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:44.076041 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2c1701a0-653c-491f-859f-1e5c958679f2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:44.212368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2c1701a0-653c-491f-859f-1e5c958679f2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:44.220243 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2c1701a0-653c-491f-859f-1e5c958679f2 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.158635 Aug 24 09:09:44.220944 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 673/1363] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:44 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:45.241559 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-133536b6-c925-48c0-8f5f-84f9bfaa34ed tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:45.242220 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-133536b6-c925-48c0-8f5f-84f9bfaa34ed tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:45.248564 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-133536b6-c925-48c0-8f5f-84f9bfaa34ed tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:45.249043 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-133536b6-c925-48c0-8f5f-84f9bfaa34ed tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:45.249473 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-133536b6-c925-48c0-8f5f-84f9bfaa34ed tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:45.250151 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-133536b6-c925-48c0-8f5f-84f9bfaa34ed tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:45.250597 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-133536b6-c925-48c0-8f5f-84f9bfaa34ed tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:45.251016 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-133536b6-c925-48c0-8f5f-84f9bfaa34ed tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:45.380014 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-133536b6-c925-48c0-8f5f-84f9bfaa34ed tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:45.388224 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-133536b6-c925-48c0-8f5f-84f9bfaa34ed tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.150648 Aug 24 09:09:45.388819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 691/1364] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:45 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:46.410585 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-0ec8f716-148d-4d29-873c-5dffb0d06331 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:46.411217 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-0ec8f716-148d-4d29-873c-5dffb0d06331 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:46.418340 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0ec8f716-148d-4d29-873c-5dffb0d06331 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:46.418810 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0ec8f716-148d-4d29-873c-5dffb0d06331 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:46.419236 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0ec8f716-148d-4d29-873c-5dffb0d06331 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:46.419912 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0ec8f716-148d-4d29-873c-5dffb0d06331 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:46.420352 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0ec8f716-148d-4d29-873c-5dffb0d06331 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:46.420799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-0ec8f716-148d-4d29-873c-5dffb0d06331 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:46.554479 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-0ec8f716-148d-4d29-873c-5dffb0d06331 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:46.562204 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-0ec8f716-148d-4d29-873c-5dffb0d06331 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.155658 Aug 24 09:09:46.562763 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 674/1365] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:46 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:47.583557 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-33e8e7d1-07b8-4164-84a6-2c9971ef549f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:47.584338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-33e8e7d1-07b8-4164-84a6-2c9971ef549f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:47.590662 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33e8e7d1-07b8-4164-84a6-2c9971ef549f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:47.591145 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33e8e7d1-07b8-4164-84a6-2c9971ef549f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:47.591581 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33e8e7d1-07b8-4164-84a6-2c9971ef549f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:47.592270 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33e8e7d1-07b8-4164-84a6-2c9971ef549f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:47.592752 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33e8e7d1-07b8-4164-84a6-2c9971ef549f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:47.593177 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-33e8e7d1-07b8-4164-84a6-2c9971ef549f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:47.728167 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-33e8e7d1-07b8-4164-84a6-2c9971ef549f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:47.735837 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-33e8e7d1-07b8-4164-84a6-2c9971ef549f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.156258 Aug 24 09:09:47.736409 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 692/1366] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:47 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:48.756751 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-570d597f-d85c-432c-92d2-9fff884f38fd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:48.757298 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-570d597f-d85c-432c-92d2-9fff884f38fd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:48.764435 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-570d597f-d85c-432c-92d2-9fff884f38fd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:48.764940 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-570d597f-d85c-432c-92d2-9fff884f38fd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:48.765359 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-570d597f-d85c-432c-92d2-9fff884f38fd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:48.766040 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-570d597f-d85c-432c-92d2-9fff884f38fd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:48.766478 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-570d597f-d85c-432c-92d2-9fff884f38fd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:48.766892 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-570d597f-d85c-432c-92d2-9fff884f38fd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:48.898173 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-570d597f-d85c-432c-92d2-9fff884f38fd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:48.908301 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-570d597f-d85c-432c-92d2-9fff884f38fd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.155548 Aug 24 09:09:48.908882 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 675/1367] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:48 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:49.936819 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-419fa71e-eef3-4391-be8a-ebb3e2b0d684 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:49.937437 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-419fa71e-eef3-4391-be8a-ebb3e2b0d684 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:49.943587 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-419fa71e-eef3-4391-be8a-ebb3e2b0d684 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:49.944065 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-419fa71e-eef3-4391-be8a-ebb3e2b0d684 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:49.944499 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-419fa71e-eef3-4391-be8a-ebb3e2b0d684 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:49.945777 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-419fa71e-eef3-4391-be8a-ebb3e2b0d684 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:49.946185 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-419fa71e-eef3-4391-be8a-ebb3e2b0d684 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:49.946622 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-419fa71e-eef3-4391-be8a-ebb3e2b0d684 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:50.076046 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-419fa71e-eef3-4391-be8a-ebb3e2b0d684 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:50.083838 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-419fa71e-eef3-4391-be8a-ebb3e2b0d684 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.150870 Aug 24 09:09:50.084341 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 693/1368] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:49 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:51.104910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-1f76616f-1fe5-4021-b6a6-c796383e713e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:51.105549 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-1f76616f-1fe5-4021-b6a6-c796383e713e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:51.111860 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f76616f-1fe5-4021-b6a6-c796383e713e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:51.112333 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f76616f-1fe5-4021-b6a6-c796383e713e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:51.112799 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f76616f-1fe5-4021-b6a6-c796383e713e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:51.113488 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f76616f-1fe5-4021-b6a6-c796383e713e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:51.113941 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f76616f-1fe5-4021-b6a6-c796383e713e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:51.114356 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-1f76616f-1fe5-4021-b6a6-c796383e713e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:51.248852 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-1f76616f-1fe5-4021-b6a6-c796383e713e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:51.256568 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-1f76616f-1fe5-4021-b6a6-c796383e713e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.155757 Aug 24 09:09:51.257120 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 676/1369] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:51 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:52.278038 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-85f3566b-c8f3-4b5a-9f84-1b9eef7ad029 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:52.278645 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-85f3566b-c8f3-4b5a-9f84-1b9eef7ad029 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:52.287103 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-85f3566b-c8f3-4b5a-9f84-1b9eef7ad029 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:52.287103 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-85f3566b-c8f3-4b5a-9f84-1b9eef7ad029 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:52.287103 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-85f3566b-c8f3-4b5a-9f84-1b9eef7ad029 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:52.287103 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-85f3566b-c8f3-4b5a-9f84-1b9eef7ad029 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:52.287565 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-85f3566b-c8f3-4b5a-9f84-1b9eef7ad029 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:52.287821 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-85f3566b-c8f3-4b5a-9f84-1b9eef7ad029 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:52.422483 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-85f3566b-c8f3-4b5a-9f84-1b9eef7ad029 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:52.430729 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-85f3566b-c8f3-4b5a-9f84-1b9eef7ad029 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.157082 Aug 24 09:09:52.431292 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 694/1370] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:52 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:53.451745 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4e03e1d0-9d82-436e-9fe3-24200d918fd0 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:53.452345 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4e03e1d0-9d82-436e-9fe3-24200d918fd0 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:53.458749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4e03e1d0-9d82-436e-9fe3-24200d918fd0 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:53.459230 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4e03e1d0-9d82-436e-9fe3-24200d918fd0 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:53.459661 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4e03e1d0-9d82-436e-9fe3-24200d918fd0 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:53.460353 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4e03e1d0-9d82-436e-9fe3-24200d918fd0 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:53.461466 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4e03e1d0-9d82-436e-9fe3-24200d918fd0 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:53.461894 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4e03e1d0-9d82-436e-9fe3-24200d918fd0 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:53.592331 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4e03e1d0-9d82-436e-9fe3-24200d918fd0 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:53.600178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4e03e1d0-9d82-436e-9fe3-24200d918fd0 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.152322 Aug 24 09:09:53.600769 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 677/1371] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:53 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:54.621230 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-53cbf94c-c5d1-4ab2-8b29-4e57af91b4c5 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:54.621854 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-53cbf94c-c5d1-4ab2-8b29-4e57af91b4c5 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:54.628255 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-53cbf94c-c5d1-4ab2-8b29-4e57af91b4c5 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:54.628773 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-53cbf94c-c5d1-4ab2-8b29-4e57af91b4c5 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:54.629205 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-53cbf94c-c5d1-4ab2-8b29-4e57af91b4c5 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:54.629889 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-53cbf94c-c5d1-4ab2-8b29-4e57af91b4c5 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:54.630333 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-53cbf94c-c5d1-4ab2-8b29-4e57af91b4c5 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:54.630749 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-53cbf94c-c5d1-4ab2-8b29-4e57af91b4c5 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:54.761865 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-53cbf94c-c5d1-4ab2-8b29-4e57af91b4c5 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:54.769698 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-53cbf94c-c5d1-4ab2-8b29-4e57af91b4c5 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.152205 Aug 24 09:09:54.770109 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 695/1372] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:54 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:55.792058 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e63705b0-bc38-4e67-be65-8f9d208ad6c6 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:55.792646 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e63705b0-bc38-4e67-be65-8f9d208ad6c6 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:55.799351 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e63705b0-bc38-4e67-be65-8f9d208ad6c6 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:55.799910 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e63705b0-bc38-4e67-be65-8f9d208ad6c6 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:55.800346 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e63705b0-bc38-4e67-be65-8f9d208ad6c6 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:55.801137 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e63705b0-bc38-4e67-be65-8f9d208ad6c6 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:55.801583 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e63705b0-bc38-4e67-be65-8f9d208ad6c6 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:55.801997 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e63705b0-bc38-4e67-be65-8f9d208ad6c6 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:56.004189 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e63705b0-bc38-4e67-be65-8f9d208ad6c6 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:56.015089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-9e34f425-c6a9-462f-b746-279d4866e29c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:56.015657 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9e34f425-c6a9-462f-b746-279d4866e29c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:56.022753 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e34f425-c6a9-462f-b746-279d4866e29c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:56.023673 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e63705b0-bc38-4e67-be65-8f9d208ad6c6 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.235514 Aug 24 09:09:56.024334 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e34f425-c6a9-462f-b746-279d4866e29c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:56.024462 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 678/1373] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:55 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:56.025073 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e34f425-c6a9-462f-b746-279d4866e29c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:56.025959 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e34f425-c6a9-462f-b746-279d4866e29c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:56.026468 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e34f425-c6a9-462f-b746-279d4866e29c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:56.026903 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-9e34f425-c6a9-462f-b746-279d4866e29c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:56.029329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-6de80ed8-778a-4649-9ad1-76efea847dc1 req-3558e9e6-884e-4a19-8072-8e7c54892014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8827f4a3-4165-449e-99fe-732606d0bb97", "tag": "110d00be-0027-4415-be65-03f3cb848994"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:56.039555 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-6de80ed8-778a-4649-9ad1-76efea847dc1 req-3558e9e6-884e-4a19-8072-8e7c54892014 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:56.040294 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-6de80ed8-778a-4649-9ad1-76efea847dc1 req-3558e9e6-884e-4a19-8072-8e7c54892014 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:56.040929 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-6de80ed8-778a-4649-9ad1-76efea847dc1 req-3558e9e6-884e-4a19-8072-8e7c54892014 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:56.052862 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-6de80ed8-778a-4649-9ad1-76efea847dc1 req-3558e9e6-884e-4a19-8072-8e7c54892014 service nova] Creating event network-changed:110d00be-0027-4415-be65-03f3cb848994 for instance 8827f4a3-4165-449e-99fe-732606d0bb97 on hv-cinder-85221 Aug 24 09:09:56.058978 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-6de80ed8-778a-4649-9ad1-76efea847dc1 req-3558e9e6-884e-4a19-8072-8e7c54892014 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032970 Aug 24 09:09:56.059805 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 679/1374] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:56.062953 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-9e34f425-c6a9-462f-b746-279d4866e29c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Going to try to terminate instance {{(pid=132984) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:09:56.304783 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-9e34f425-c6a9-462f-b746-279d4866e29c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 204 len: 0 microversion: 2.1 time: 0.293502 Aug 24 09:09:56.305451 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 696/1375] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:09:56 2022] DELETE /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:09:56.321469 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ef377fe6-d764-4cc1-a067-087689f38490 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:56.321469 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ef377fe6-d764-4cc1-a067-087689f38490 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:56.321469 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef377fe6-d764-4cc1-a067-087689f38490 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:56.321849 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef377fe6-d764-4cc1-a067-087689f38490 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:56.322213 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef377fe6-d764-4cc1-a067-087689f38490 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:56.323158 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef377fe6-d764-4cc1-a067-087689f38490 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:56.323604 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef377fe6-d764-4cc1-a067-087689f38490 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:56.324207 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ef377fe6-d764-4cc1-a067-087689f38490 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:56.468223 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ef377fe6-d764-4cc1-a067-087689f38490 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:56.476921 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ef377fe6-d764-4cc1-a067-087689f38490 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1577 microversion: 2.1 time: 0.166567 Aug 24 09:09:56.477806 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 680/1376] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:56 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:57.045941 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3a4096a8-8bfa-4447-98c9-0332528378f9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:57.046708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3a4096a8-8bfa-4447-98c9-0332528378f9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:57.053205 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3a4096a8-8bfa-4447-98c9-0332528378f9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:57.053682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3a4096a8-8bfa-4447-98c9-0332528378f9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:57.054116 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3a4096a8-8bfa-4447-98c9-0332528378f9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:57.054802 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3a4096a8-8bfa-4447-98c9-0332528378f9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:57.055251 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3a4096a8-8bfa-4447-98c9-0332528378f9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:57.055672 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3a4096a8-8bfa-4447-98c9-0332528378f9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:57.073840 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:57.187403 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-3a4096a8-8bfa-4447-98c9-0332528378f9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:57.195425 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3a4096a8-8bfa-4447-98c9-0332528378f9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.153560 Aug 24 09:09:57.196429 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 697/1377] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:57 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:57.498607 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b8783e54-9eb7-4d6a-8c6c-6b63377a7dea tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:57.499235 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b8783e54-9eb7-4d6a-8c6c-6b63377a7dea tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:57.506311 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8783e54-9eb7-4d6a-8c6c-6b63377a7dea tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:57.506795 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8783e54-9eb7-4d6a-8c6c-6b63377a7dea tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:57.507435 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8783e54-9eb7-4d6a-8c6c-6b63377a7dea tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:57.508981 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8783e54-9eb7-4d6a-8c6c-6b63377a7dea tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:57.509651 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8783e54-9eb7-4d6a-8c6c-6b63377a7dea tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:57.510085 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b8783e54-9eb7-4d6a-8c6c-6b63377a7dea tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:57.674190 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b8783e54-9eb7-4d6a-8c6c-6b63377a7dea tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:57.682551 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b8783e54-9eb7-4d6a-8c6c-6b63377a7dea tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1577 microversion: 2.1 time: 0.187963 Aug 24 09:09:57.683117 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 681/1378] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:57 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:58.217156 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-710f7b09-fca6-498f-b74d-a6375d819efc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:58.221088 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-710f7b09-fca6-498f-b74d-a6375d819efc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:58.224252 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-710f7b09-fca6-498f-b74d-a6375d819efc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:58.224774 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-710f7b09-fca6-498f-b74d-a6375d819efc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:58.225203 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-710f7b09-fca6-498f-b74d-a6375d819efc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:58.225879 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-710f7b09-fca6-498f-b74d-a6375d819efc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:58.226322 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-710f7b09-fca6-498f-b74d-a6375d819efc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:58.226738 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-710f7b09-fca6-498f-b74d-a6375d819efc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:58.361338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-710f7b09-fca6-498f-b74d-a6375d819efc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:58.369187 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-710f7b09-fca6-498f-b74d-a6375d819efc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.155962 Aug 24 09:09:58.369750 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 698/1379] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:58 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:58.706378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-54f6a7ac-f7da-4c0f-82a5-43b2c3523f88 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:58.707665 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-54f6a7ac-f7da-4c0f-82a5-43b2c3523f88 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:58.715187 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54f6a7ac-f7da-4c0f-82a5-43b2c3523f88 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:58.715668 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54f6a7ac-f7da-4c0f-82a5-43b2c3523f88 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:58.716101 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54f6a7ac-f7da-4c0f-82a5-43b2c3523f88 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:58.717103 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54f6a7ac-f7da-4c0f-82a5-43b2c3523f88 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:58.717556 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54f6a7ac-f7da-4c0f-82a5-43b2c3523f88 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:58.718086 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-54f6a7ac-f7da-4c0f-82a5-43b2c3523f88 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:58.918430 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-54f6a7ac-f7da-4c0f-82a5-43b2c3523f88 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:58.926740 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-54f6a7ac-f7da-4c0f-82a5-43b2c3523f88 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1577 microversion: 2.1 time: 0.224331 Aug 24 09:09:58.927450 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 682/1380] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:58 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:59.390633 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-01c560d1-36dc-4db6-9af4-18896e94d76c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:59.391263 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-01c560d1-36dc-4db6-9af4-18896e94d76c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:59.397585 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01c560d1-36dc-4db6-9af4-18896e94d76c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:59.398058 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01c560d1-36dc-4db6-9af4-18896e94d76c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:59.398486 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01c560d1-36dc-4db6-9af4-18896e94d76c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:59.399165 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01c560d1-36dc-4db6-9af4-18896e94d76c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:59.399606 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01c560d1-36dc-4db6-9af4-18896e94d76c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:59.400019 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01c560d1-36dc-4db6-9af4-18896e94d76c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:59.536579 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-01c560d1-36dc-4db6-9af4-18896e94d76c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:59.546489 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-01c560d1-36dc-4db6-9af4-18896e94d76c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.159707 Aug 24 09:09:59.547598 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 699/1381] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:59 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:09:59.949313 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-724e67f0-e7f8-47db-9327-92e27a2d1d1d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:59.949915 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-724e67f0-e7f8-47db-9327-92e27a2d1d1d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:59.956592 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-724e67f0-e7f8-47db-9327-92e27a2d1d1d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:59.957157 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-724e67f0-e7f8-47db-9327-92e27a2d1d1d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:59.957693 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-724e67f0-e7f8-47db-9327-92e27a2d1d1d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:59.958477 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-724e67f0-e7f8-47db-9327-92e27a2d1d1d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:59.958929 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-724e67f0-e7f8-47db-9327-92e27a2d1d1d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:59.959368 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-724e67f0-e7f8-47db-9327-92e27a2d1d1d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:00.106069 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-724e67f0-e7f8-47db-9327-92e27a2d1d1d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:00.113751 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-724e67f0-e7f8-47db-9327-92e27a2d1d1d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1458 microversion: 2.1 time: 0.168295 Aug 24 09:10:00.114302 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 683/1382] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:59 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1458 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:00.569175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-09225633-2a84-458f-9656-e2a29c165080 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:00.569814 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-09225633-2a84-458f-9656-e2a29c165080 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:00.577017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-09225633-2a84-458f-9656-e2a29c165080 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:00.577490 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-09225633-2a84-458f-9656-e2a29c165080 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:00.577925 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-09225633-2a84-458f-9656-e2a29c165080 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:00.578733 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-09225633-2a84-458f-9656-e2a29c165080 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:00.579182 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-09225633-2a84-458f-9656-e2a29c165080 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:00.579685 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-09225633-2a84-458f-9656-e2a29c165080 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:00.714924 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-09225633-2a84-458f-9656-e2a29c165080 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:00.722676 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-09225633-2a84-458f-9656-e2a29c165080 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.157489 Aug 24 09:10:00.723242 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 700/1383] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:00 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:01.135560 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-3b85ea8b-f23d-4636-9712-6659d058ea4c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:01.136178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-3b85ea8b-f23d-4636-9712-6659d058ea4c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:01.142945 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3b85ea8b-f23d-4636-9712-6659d058ea4c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:01.143427 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3b85ea8b-f23d-4636-9712-6659d058ea4c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:01.143863 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3b85ea8b-f23d-4636-9712-6659d058ea4c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:01.144616 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3b85ea8b-f23d-4636-9712-6659d058ea4c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:01.145072 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3b85ea8b-f23d-4636-9712-6659d058ea4c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:01.145506 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-3b85ea8b-f23d-4636-9712-6659d058ea4c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:01.373867 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-3b85ea8b-f23d-4636-9712-6659d058ea4c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:01.381460 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-3b85ea8b-f23d-4636-9712-6659d058ea4c tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1458 microversion: 2.1 time: 0.250738 Aug 24 09:10:01.382032 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 684/1384] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:01 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1458 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:01.695713 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-be846e16-9007-4628-a729-f69e95db5569 req-992930e6-2dee-405f-9fa0-13b1014b0c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8827f4a3-4165-449e-99fe-732606d0bb97", "name": "network-vif-deleted", "tag": "110d00be-0027-4415-be65-03f3cb848994"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:10:01.705681 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-be846e16-9007-4628-a729-f69e95db5569 req-992930e6-2dee-405f-9fa0-13b1014b0c96 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:01.706150 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-be846e16-9007-4628-a729-f69e95db5569 req-992930e6-2dee-405f-9fa0-13b1014b0c96 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:01.714875 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-be846e16-9007-4628-a729-f69e95db5569 req-992930e6-2dee-405f-9fa0-13b1014b0c96 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:01.717264 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-be846e16-9007-4628-a729-f69e95db5569 req-992930e6-2dee-405f-9fa0-13b1014b0c96 service nova] Creating event network-vif-deleted:110d00be-0027-4415-be65-03f3cb848994 for instance 8827f4a3-4165-449e-99fe-732606d0bb97 on hv-cinder-85221 Aug 24 09:10:01.722268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-be846e16-9007-4628-a729-f69e95db5569 req-992930e6-2dee-405f-9fa0-13b1014b0c96 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030248 Aug 24 09:10:01.723200 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 701/1385] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:10:01.743582 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-6ea5c061-499d-4627-8ae3-401b6e3f9c6f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:01.744164 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-6ea5c061-499d-4627-8ae3-401b6e3f9c6f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:01.750719 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6ea5c061-499d-4627-8ae3-401b6e3f9c6f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:01.751197 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6ea5c061-499d-4627-8ae3-401b6e3f9c6f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:01.751629 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6ea5c061-499d-4627-8ae3-401b6e3f9c6f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:01.752315 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6ea5c061-499d-4627-8ae3-401b6e3f9c6f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:01.752801 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6ea5c061-499d-4627-8ae3-401b6e3f9c6f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:01.753219 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-6ea5c061-499d-4627-8ae3-401b6e3f9c6f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:01.757276 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=100 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:10:01.888462 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-6ea5c061-499d-4627-8ae3-401b6e3f9c6f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:01.896503 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-6ea5c061-499d-4627-8ae3-401b6e3f9c6f tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.156868 Aug 24 09:10:01.897095 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 685/1386] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:01 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:10:02.403953 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:02.404692 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:02.406730 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:10:02.412101 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:02.412618 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:02.415373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:02.415373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:02.415373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:02.415373 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:02.449817 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:02.450301 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:02.450759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:02.455506 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.objects.instance [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lazy-loading 'fault' on Instance uuid 8827f4a3-4165-449e-99fe-732606d0bb97 {{(pid=132984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:10:02.499498 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:02.507319 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-cddb9f4a-b010-4a9f-826d-def24ee045c4 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 200 len: 1230 microversion: 2.1 time: 0.107670 Aug 24 09:10:02.508317 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 702/1387] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:02 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:02.918030 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-b0593720-c2b9-47fb-b2ef-4722a3a29525 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:02.918734 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-b0593720-c2b9-47fb-b2ef-4722a3a29525 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:02.925067 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0593720-c2b9-47fb-b2ef-4722a3a29525 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:02.925541 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0593720-c2b9-47fb-b2ef-4722a3a29525 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:02.925973 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0593720-c2b9-47fb-b2ef-4722a3a29525 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:02.926660 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0593720-c2b9-47fb-b2ef-4722a3a29525 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:02.927136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0593720-c2b9-47fb-b2ef-4722a3a29525 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:02.927554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-b0593720-c2b9-47fb-b2ef-4722a3a29525 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:03.066518 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-b0593720-c2b9-47fb-b2ef-4722a3a29525 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:03.074226 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-b0593720-c2b9-47fb-b2ef-4722a3a29525 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1510 microversion: 2.1 time: 0.160117 Aug 24 09:10:03.074785 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 686/1388] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:02 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:03.094813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7299facb-3da6-4b5e-888c-d115e7ab474b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:10:03.095409 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7299facb-3da6-4b5e-888c-d115e7ab474b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:03.101588 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7299facb-3da6-4b5e-888c-d115e7ab474b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:03.105525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7299facb-3da6-4b5e-888c-d115e7ab474b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:03.105525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7299facb-3da6-4b5e-888c-d115e7ab474b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:03.105525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7299facb-3da6-4b5e-888c-d115e7ab474b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:03.105525 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7299facb-3da6-4b5e-888c-d115e7ab474b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:03.106012 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7299facb-3da6-4b5e-888c-d115e7ab474b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:03.134005 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7299facb-3da6-4b5e-888c-d115e7ab474b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132984) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 09:10:03.386414 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7299facb-3da6-4b5e-888c-d115e7ab474b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "POST /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb/action" status: 202 len: 0 microversion: 2.1 time: 0.296153 Aug 24 09:10:03.387028 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 703/1389] 10.222.0.55 () {60 vars in 1278 bytes} [Wed Aug 24 09:10:03 2022] POST /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:10:03.395390 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8bb4ab75-1e8e-4e26-874e-4aa170b346a9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:03.396002 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8bb4ab75-1e8e-4e26-874e-4aa170b346a9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:03.402853 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8bb4ab75-1e8e-4e26-874e-4aa170b346a9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:03.403788 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8bb4ab75-1e8e-4e26-874e-4aa170b346a9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:03.403788 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8bb4ab75-1e8e-4e26-874e-4aa170b346a9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:03.404473 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8bb4ab75-1e8e-4e26-874e-4aa170b346a9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:03.405035 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8bb4ab75-1e8e-4e26-874e-4aa170b346a9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:03.405365 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8bb4ab75-1e8e-4e26-874e-4aa170b346a9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:03.529575 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-75aca717-d479-4fe0-b54d-1a4c5120acb8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:03.530235 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-75aca717-d479-4fe0-b54d-1a4c5120acb8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 8827f4a3-4165-449e-99fe-732606d0bb97] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:03.537748 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-75aca717-d479-4fe0-b54d-1a4c5120acb8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:03.538277 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-75aca717-d479-4fe0-b54d-1a4c5120acb8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:03.538883 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-75aca717-d479-4fe0-b54d-1a4c5120acb8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:03.539416 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-8bb4ab75-1e8e-4e26-874e-4aa170b346a9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:03.539902 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-75aca717-d479-4fe0-b54d-1a4c5120acb8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:03.540392 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-75aca717-d479-4fe0-b54d-1a4c5120acb8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:03.540919 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-75aca717-d479-4fe0-b54d-1a4c5120acb8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:03.548792 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8bb4ab75-1e8e-4e26-874e-4aa170b346a9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1518 microversion: 2.1 time: 0.157204 Aug 24 09:10:03.549563 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 687/1390] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:03 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:10:03.565338 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-75aca717-d479-4fe0-b54d-1a4c5120acb8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] HTTP exception thrown: Instance 8827f4a3-4165-449e-99fe-732606d0bb97 could not be found. Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-75aca717-d479-4fe0-b54d-1a4c5120acb8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Request method failure captured: Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 HTTP/1.1 Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeha-c6uiuuPA8C79UuMcsTyaozqrSUaLK66JryF0q8DuN1JdixUvG99ZjPsPrGKl_XPJu2oT3faRBPoBHuFCRYw3w1Xa0bYcDM-c8_Xy49TW6uQIRSCl8eF4lbHkKlGRr6dwzaidJVDZo2aA8EIES-QOq71MpdD0AvXjsMXZ4f31MA Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 1f01e21018a54220ba1e54c6b7bfc400 Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:10:03.568682 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:10:03.570449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1f01e21018a54220ba1e54c6b7bfc400", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:10:03.570449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:10:03.570449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 1f01e21018a54220ba1e54c6b7bfc400 Aug 24 09:10:03.570449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:10:03.570449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-TestVolumeBootPattern-1568297340-project Aug 24 09:10:03.570449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:10:03.570449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:10:03.570449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: c2c3752027f342a489e6eb9d3b540819 Aug 24 09:10:03.570449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-TestVolumeBootPattern-1568297340-project Aug 24 09:10:03.570449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:10:03.570449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 8827f4a3-4165-449e-99fe-732606d0bb97 could not be found. Aug 24 09:10:03.570449 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '8827f4a3-4165-449e-99fe-732606d0bb97'} Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8827f4a3-4165-449e-99fe-732606d0bb97 could not be found. Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:10:03.571493 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8827f4a3-4165-449e-99fe-732606d0bb97 could not be found. Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8827f4a3-4165-449e-99fe-732606d0bb97 could not be found. Aug 24 09:10:03.574129 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:10:03.575751 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-75aca717-d479-4fe0-b54d-1a4c5120acb8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Returning 404 to user: Instance 8827f4a3-4165-449e-99fe-732606d0bb97 could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:10:03.575751 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-75aca717-d479-4fe0-b54d-1a4c5120acb8 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97" status: 404 len: 111 microversion: 2.1 time: 0.043801 Aug 24 09:10:03.575751 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 704/1391] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:03 2022] GET /compute/v2.1/servers/8827f4a3-4165-449e-99fe-732606d0bb97 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 09:10:04.569554 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-a34a8166-60b0-477f-a1c4-5402017c07b3 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:04.570153 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-a34a8166-60b0-477f-a1c4-5402017c07b3 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:04.576163 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a34a8166-60b0-477f-a1c4-5402017c07b3 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:04.576675 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a34a8166-60b0-477f-a1c4-5402017c07b3 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:04.577111 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a34a8166-60b0-477f-a1c4-5402017c07b3 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:04.577781 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a34a8166-60b0-477f-a1c4-5402017c07b3 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:04.578222 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a34a8166-60b0-477f-a1c4-5402017c07b3 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:04.578631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-a34a8166-60b0-477f-a1c4-5402017c07b3 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:04.716092 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-a34a8166-60b0-477f-a1c4-5402017c07b3 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:04.726508 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-a34a8166-60b0-477f-a1c4-5402017c07b3 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1518 microversion: 2.1 time: 0.160969 Aug 24 09:10:04.728626 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 688/1392] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:04 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:05.454850 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-60499666-de22-4719-8dab-ba0fc0c4ad82 req-c80b2e39-8f2b-4cfb-9db3-14022de1ecf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d117b5-1850-4c20-9c32-177d76a0f5bb", "name": "network-vif-unplugged", "status": "completed", "tag": "a316d1ef-63e0-44df-bde0-c53760d141f5"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:10:05.465799 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-60499666-de22-4719-8dab-ba0fc0c4ad82 req-c80b2e39-8f2b-4cfb-9db3-14022de1ecf6 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:05.466320 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-60499666-de22-4719-8dab-ba0fc0c4ad82 req-c80b2e39-8f2b-4cfb-9db3-14022de1ecf6 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:05.466702 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-60499666-de22-4719-8dab-ba0fc0c4ad82 req-c80b2e39-8f2b-4cfb-9db3-14022de1ecf6 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:05.478336 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.compute.server_external_events [req-60499666-de22-4719-8dab-ba0fc0c4ad82 req-c80b2e39-8f2b-4cfb-9db3-14022de1ecf6 service nova] Unable to find a host for instance 35d117b5-1850-4c20-9c32-177d76a0f5bb. Dropping event network-vif-unplugged {{(pid=132984) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 09:10:05.479213 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-60499666-de22-4719-8dab-ba0fc0c4ad82 req-c80b2e39-8f2b-4cfb-9db3-14022de1ecf6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028436 Aug 24 09:10:05.479799 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 705/1393] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 09:10:05.749120 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-2227d930-e52e-4a0d-b102-c23e638b9cc1 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:05.749730 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-2227d930-e52e-4a0d-b102-c23e638b9cc1 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:05.752033 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=43 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:10:05.756722 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2227d930-e52e-4a0d-b102-c23e638b9cc1 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:05.757203 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2227d930-e52e-4a0d-b102-c23e638b9cc1 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:05.760950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2227d930-e52e-4a0d-b102-c23e638b9cc1 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:05.760950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2227d930-e52e-4a0d-b102-c23e638b9cc1 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:05.760950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2227d930-e52e-4a0d-b102-c23e638b9cc1 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:05.760950 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-2227d930-e52e-4a0d-b102-c23e638b9cc1 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:05.899978 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-2227d930-e52e-4a0d-b102-c23e638b9cc1 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:05.907858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-2227d930-e52e-4a0d-b102-c23e638b9cc1 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1520 microversion: 2.1 time: 0.163149 Aug 24 09:10:05.908424 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 689/1394] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:05 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:10:06.930023 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-01a5b667-10ec-40c4-8c4e-a34382359e55 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:06.930777 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-01a5b667-10ec-40c4-8c4e-a34382359e55 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:06.940801 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01a5b667-10ec-40c4-8c4e-a34382359e55 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:06.941371 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01a5b667-10ec-40c4-8c4e-a34382359e55 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:06.948415 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01a5b667-10ec-40c4-8c4e-a34382359e55 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:06.948415 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01a5b667-10ec-40c4-8c4e-a34382359e55 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:06.948415 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01a5b667-10ec-40c4-8c4e-a34382359e55 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:06.948415 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-01a5b667-10ec-40c4-8c4e-a34382359e55 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:07.129319 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-01a5b667-10ec-40c4-8c4e-a34382359e55 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:07.137770 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-01a5b667-10ec-40c4-8c4e-a34382359e55 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1520 microversion: 2.1 time: 0.211853 Aug 24 09:10:07.138350 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 706/1395] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:06 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:07.218385 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-e54e6f81-56cb-44f9-b2ca-23341caf591a req-c4869134-3595-42fa-a671-09150d057064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b018901-74c5-4165-9944-187550602e1b", "tag": "9b0a2310-da6c-4502-994f-28bf901ef586"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:10:07.221335 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-8362e29c-4e3c-42ca-b9c9-0757a05f4c83 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:07.221787 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8362e29c-4e3c-42ca-b9c9-0757a05f4c83 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:07.236156 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8362e29c-4e3c-42ca-b9c9-0757a05f4c83 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:07.241971 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8362e29c-4e3c-42ca-b9c9-0757a05f4c83 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:07.242495 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8362e29c-4e3c-42ca-b9c9-0757a05f4c83 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:07.244153 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-e54e6f81-56cb-44f9-b2ca-23341caf591a req-c4869134-3595-42fa-a671-09150d057064 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:07.245588 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8362e29c-4e3c-42ca-b9c9-0757a05f4c83 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:07.247163 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8362e29c-4e3c-42ca-b9c9-0757a05f4c83 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:07.248903 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-8362e29c-4e3c-42ca-b9c9-0757a05f4c83 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:07.249035 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-e54e6f81-56cb-44f9-b2ca-23341caf591a req-c4869134-3595-42fa-a671-09150d057064 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:07.249035 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-e54e6f81-56cb-44f9-b2ca-23341caf591a req-c4869134-3595-42fa-a671-09150d057064 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:07.264114 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-e54e6f81-56cb-44f9-b2ca-23341caf591a req-c4869134-3595-42fa-a671-09150d057064 service nova] Creating event network-changed:9b0a2310-da6c-4502-994f-28bf901ef586 for instance 3b018901-74c5-4165-9944-187550602e1b on hv-cinder-85221 Aug 24 09:10:07.269877 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-e54e6f81-56cb-44f9-b2ca-23341caf591a req-c4869134-3595-42fa-a671-09150d057064 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060143 Aug 24 09:10:07.270780 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 707/1396] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:10:07.280216 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-8362e29c-4e3c-42ca-b9c9-0757a05f4c83 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Going to try to terminate instance {{(pid=132985) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:10:07.664946 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-8362e29c-4e3c-42ca-b9c9-0757a05f4c83 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 204 len: 0 microversion: 2.1 time: 0.462384 Aug 24 09:10:07.667285 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 690/1397] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:10:07 2022] DELETE /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:10:07.681286 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-e512cfe5-dad9-45c7-a3bb-8790fa4dae28 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:07.681286 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-e512cfe5-dad9-45c7-a3bb-8790fa4dae28 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:07.691488 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e512cfe5-dad9-45c7-a3bb-8790fa4dae28 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:07.692323 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e512cfe5-dad9-45c7-a3bb-8790fa4dae28 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:07.693055 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e512cfe5-dad9-45c7-a3bb-8790fa4dae28 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:07.693791 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e512cfe5-dad9-45c7-a3bb-8790fa4dae28 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:07.694247 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e512cfe5-dad9-45c7-a3bb-8790fa4dae28 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:07.694677 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-e512cfe5-dad9-45c7-a3bb-8790fa4dae28 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:07.906279 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-e512cfe5-dad9-45c7-a3bb-8790fa4dae28 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:07.920926 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-e512cfe5-dad9-45c7-a3bb-8790fa4dae28 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1575 microversion: 2.1 time: 0.249240 Aug 24 09:10:07.922315 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 708/1398] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:07 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:10:08.162785 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-dee86cc7-0735-4731-ae46-e043dd18f2cd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:08.163408 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-dee86cc7-0735-4731-ae46-e043dd18f2cd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:08.169653 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dee86cc7-0735-4731-ae46-e043dd18f2cd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:08.170670 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dee86cc7-0735-4731-ae46-e043dd18f2cd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:08.171166 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dee86cc7-0735-4731-ae46-e043dd18f2cd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:08.171819 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dee86cc7-0735-4731-ae46-e043dd18f2cd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:08.172265 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dee86cc7-0735-4731-ae46-e043dd18f2cd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:08.172741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-dee86cc7-0735-4731-ae46-e043dd18f2cd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:08.426463 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-dee86cc7-0735-4731-ae46-e043dd18f2cd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:08.435316 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-dee86cc7-0735-4731-ae46-e043dd18f2cd tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.279743 Aug 24 09:10:08.435885 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 691/1399] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:08 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1576 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:08.942899 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-affdef59-af83-4799-9ede-8ffe496fdce7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:08.943523 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-affdef59-af83-4799-9ede-8ffe496fdce7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:08.950350 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-affdef59-af83-4799-9ede-8ffe496fdce7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:08.950834 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-affdef59-af83-4799-9ede-8ffe496fdce7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:08.951302 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-affdef59-af83-4799-9ede-8ffe496fdce7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:08.952008 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-affdef59-af83-4799-9ede-8ffe496fdce7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:08.952460 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-affdef59-af83-4799-9ede-8ffe496fdce7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:08.952914 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-affdef59-af83-4799-9ede-8ffe496fdce7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:09.088710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-affdef59-af83-4799-9ede-8ffe496fdce7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:09.096367 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-affdef59-af83-4799-9ede-8ffe496fdce7 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1457 microversion: 2.1 time: 0.157505 Aug 24 09:10:09.096957 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 709/1400] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:08 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1457 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:09.462113 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5bd8159d-34f0-4297-85e6-20c4bfc4a661 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:09.462887 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5bd8159d-34f0-4297-85e6-20c4bfc4a661 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:09.469623 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5bd8159d-34f0-4297-85e6-20c4bfc4a661 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:09.470109 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5bd8159d-34f0-4297-85e6-20c4bfc4a661 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:09.470612 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5bd8159d-34f0-4297-85e6-20c4bfc4a661 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:09.471380 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5bd8159d-34f0-4297-85e6-20c4bfc4a661 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:09.471838 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5bd8159d-34f0-4297-85e6-20c4bfc4a661 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:09.472261 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5bd8159d-34f0-4297-85e6-20c4bfc4a661 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:09.611805 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5bd8159d-34f0-4297-85e6-20c4bfc4a661 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:09.620831 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5bd8159d-34f0-4297-85e6-20c4bfc4a661 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.162490 Aug 24 09:10:09.622323 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 692/1401] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:09 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:09.980124 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [req-5b16bb1c-2bb0-41ae-82ce-7b85d96e5605 req-763bd7e3-bdf2-441b-98f5-6e5edeee20b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b018901-74c5-4165-9944-187550602e1b", "name": "network-vif-deleted", "tag": "9b0a2310-da6c-4502-994f-28bf901ef586"}]} {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:10:09.990046 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-5b16bb1c-2bb0-41ae-82ce-7b85d96e5605 req-763bd7e3-bdf2-441b-98f5-6e5edeee20b1 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:09.990510 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-5b16bb1c-2bb0-41ae-82ce-7b85d96e5605 req-763bd7e3-bdf2-441b-98f5-6e5edeee20b1 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:09.997506 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [req-5b16bb1c-2bb0-41ae-82ce-7b85d96e5605 req-763bd7e3-bdf2-441b-98f5-6e5edeee20b1 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:10.008842 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.compute.server_external_events [req-5b16bb1c-2bb0-41ae-82ce-7b85d96e5605 req-763bd7e3-bdf2-441b-98f5-6e5edeee20b1 service nova] Creating event network-vif-deleted:9b0a2310-da6c-4502-994f-28bf901ef586 for instance 3b018901-74c5-4165-9944-187550602e1b on hv-cinder-85221 Aug 24 09:10:10.018379 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [req-5b16bb1c-2bb0-41ae-82ce-7b85d96e5605 req-763bd7e3-bdf2-441b-98f5-6e5edeee20b1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040280 Aug 24 09:10:10.021157 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 710/1402] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:10:10.118530 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5cad8b7b-8e77-4cba-bdc0-b96ec699f70d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:10.119096 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5cad8b7b-8e77-4cba-bdc0-b96ec699f70d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:10.125100 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5cad8b7b-8e77-4cba-bdc0-b96ec699f70d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:10.125572 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5cad8b7b-8e77-4cba-bdc0-b96ec699f70d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:10.126005 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5cad8b7b-8e77-4cba-bdc0-b96ec699f70d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:10.126688 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5cad8b7b-8e77-4cba-bdc0-b96ec699f70d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:10.127128 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5cad8b7b-8e77-4cba-bdc0-b96ec699f70d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:10.127543 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5cad8b7b-8e77-4cba-bdc0-b96ec699f70d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:10.195304 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5cad8b7b-8e77-4cba-bdc0-b96ec699f70d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:10.203440 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5cad8b7b-8e77-4cba-bdc0-b96ec699f70d tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1390 microversion: 2.1 time: 0.088810 Aug 24 09:10:10.204527 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 693/1403] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:10 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:10.645579 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-1d753a30-4a97-4877-9e43-b2c56b246268 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:10.645579 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-1d753a30-4a97-4877-9e43-b2c56b246268 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:10.651363 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d753a30-4a97-4877-9e43-b2c56b246268 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:10.651982 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d753a30-4a97-4877-9e43-b2c56b246268 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:10.652680 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d753a30-4a97-4877-9e43-b2c56b246268 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:10.653393 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d753a30-4a97-4877-9e43-b2c56b246268 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:10.653841 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d753a30-4a97-4877-9e43-b2c56b246268 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:10.654260 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-1d753a30-4a97-4877-9e43-b2c56b246268 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:10.791005 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-1d753a30-4a97-4877-9e43-b2c56b246268 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:10.798775 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-1d753a30-4a97-4877-9e43-b2c56b246268 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.160324 Aug 24 09:10:10.799331 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 711/1404] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:10 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:11.230145 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-94b5ba8a-8c31-40e9-98c2-a32f99b2ced6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:11.230749 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-94b5ba8a-8c31-40e9-98c2-a32f99b2ced6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:11.237257 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-94b5ba8a-8c31-40e9-98c2-a32f99b2ced6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:11.237731 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-94b5ba8a-8c31-40e9-98c2-a32f99b2ced6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:11.238160 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-94b5ba8a-8c31-40e9-98c2-a32f99b2ced6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:11.238873 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-94b5ba8a-8c31-40e9-98c2-a32f99b2ced6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:11.239346 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-94b5ba8a-8c31-40e9-98c2-a32f99b2ced6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:11.239760 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-94b5ba8a-8c31-40e9-98c2-a32f99b2ced6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:11.305167 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-94b5ba8a-8c31-40e9-98c2-a32f99b2ced6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:11.313524 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-94b5ba8a-8c31-40e9-98c2-a32f99b2ced6 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1390 microversion: 2.1 time: 0.087802 Aug 24 09:10:11.315912 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 694/1405] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:11 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:11.819233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-a1a85e33-468f-4f14-a9f2-875a16ef0021 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:11.819930 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-a1a85e33-468f-4f14-a9f2-875a16ef0021 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:11.827070 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a1a85e33-468f-4f14-a9f2-875a16ef0021 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:11.827547 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a1a85e33-468f-4f14-a9f2-875a16ef0021 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:11.827986 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a1a85e33-468f-4f14-a9f2-875a16ef0021 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:11.828720 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a1a85e33-468f-4f14-a9f2-875a16ef0021 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:11.829175 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a1a85e33-468f-4f14-a9f2-875a16ef0021 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:11.829593 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-a1a85e33-468f-4f14-a9f2-875a16ef0021 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:11.969111 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-a1a85e33-468f-4f14-a9f2-875a16ef0021 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:11.977265 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-a1a85e33-468f-4f14-a9f2-875a16ef0021 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.161896 Aug 24 09:10:11.978009 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 712/1406] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:11 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:12.335014 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-4b736433-6ff1-44ea-bd99-3bc44b4c679e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:12.335622 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-4b736433-6ff1-44ea-bd99-3bc44b4c679e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:12.342471 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4b736433-6ff1-44ea-bd99-3bc44b4c679e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:12.342956 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4b736433-6ff1-44ea-bd99-3bc44b4c679e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:12.343419 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4b736433-6ff1-44ea-bd99-3bc44b4c679e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:12.344104 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4b736433-6ff1-44ea-bd99-3bc44b4c679e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:12.344620 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4b736433-6ff1-44ea-bd99-3bc44b4c679e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:12.345020 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-4b736433-6ff1-44ea-bd99-3bc44b4c679e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:12.407603 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-4b736433-6ff1-44ea-bd99-3bc44b4c679e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:12.415737 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-4b736433-6ff1-44ea-bd99-3bc44b4c679e tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1390 microversion: 2.1 time: 0.084569 Aug 24 09:10:12.416714 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 695/1407] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:12 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:13.004022 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-5a80c412-8ee4-4eb2-b46f-36885f98114d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:13.004022 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-5a80c412-8ee4-4eb2-b46f-36885f98114d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:13.005810 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5a80c412-8ee4-4eb2-b46f-36885f98114d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:13.006284 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5a80c412-8ee4-4eb2-b46f-36885f98114d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:13.006710 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5a80c412-8ee4-4eb2-b46f-36885f98114d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:13.007398 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5a80c412-8ee4-4eb2-b46f-36885f98114d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:13.007840 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5a80c412-8ee4-4eb2-b46f-36885f98114d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:13.008253 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-5a80c412-8ee4-4eb2-b46f-36885f98114d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:13.144814 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-5a80c412-8ee4-4eb2-b46f-36885f98114d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:13.153142 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-5a80c412-8ee4-4eb2-b46f-36885f98114d tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.158470 Aug 24 09:10:13.153719 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 713/1408] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:12 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:10:13.436601 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-ed5d89f3-b134-4dc0-82b3-ab3387dfc002 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:13.437278 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-ed5d89f3-b134-4dc0-82b3-ab3387dfc002 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:13.443670 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed5d89f3-b134-4dc0-82b3-ab3387dfc002 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:13.444144 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed5d89f3-b134-4dc0-82b3-ab3387dfc002 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:13.444595 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed5d89f3-b134-4dc0-82b3-ab3387dfc002 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:13.445286 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed5d89f3-b134-4dc0-82b3-ab3387dfc002 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:13.445726 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed5d89f3-b134-4dc0-82b3-ab3387dfc002 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:13.446138 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-ed5d89f3-b134-4dc0-82b3-ab3387dfc002 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:13.508969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-ed5d89f3-b134-4dc0-82b3-ab3387dfc002 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c3752027f342a489e6eb9d3b540819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f01e21018a54220ba1e54c6b7bfc400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:13.518089 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-ed5d89f3-b134-4dc0-82b3-ab3387dfc002 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 200 len: 1225 microversion: 2.1 time: 0.085441 Aug 24 09:10:13.518700 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 696/1409] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:13 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:14.175203 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-434a7caf-6da1-4156-8461-f7f3a5ec9e41 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:14.175808 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-434a7caf-6da1-4156-8461-f7f3a5ec9e41 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:14.183103 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-434a7caf-6da1-4156-8461-f7f3a5ec9e41 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:14.183538 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-434a7caf-6da1-4156-8461-f7f3a5ec9e41 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:14.183972 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-434a7caf-6da1-4156-8461-f7f3a5ec9e41 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:14.184684 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-434a7caf-6da1-4156-8461-f7f3a5ec9e41 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:14.185134 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-434a7caf-6da1-4156-8461-f7f3a5ec9e41 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:14.185561 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-434a7caf-6da1-4156-8461-f7f3a5ec9e41 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:14.331792 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-434a7caf-6da1-4156-8461-f7f3a5ec9e41 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:14.340625 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-434a7caf-6da1-4156-8461-f7f3a5ec9e41 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.169229 Aug 24 09:10:14.354198 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 714/1410] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:14 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:14.540288 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e96aab23-ad1d-4033-8810-9d70776c916b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:14.540899 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e96aab23-ad1d-4033-8810-9d70776c916b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 3b018901-74c5-4165-9944-187550602e1b] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:14.549650 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e96aab23-ad1d-4033-8810-9d70776c916b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:14.558498 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e96aab23-ad1d-4033-8810-9d70776c916b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:14.558498 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e96aab23-ad1d-4033-8810-9d70776c916b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:14.558498 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e96aab23-ad1d-4033-8810-9d70776c916b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:14.558498 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e96aab23-ad1d-4033-8810-9d70776c916b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:14.558963 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e96aab23-ad1d-4033-8810-9d70776c916b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:14.566313 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-e96aab23-ad1d-4033-8810-9d70776c916b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] HTTP exception thrown: Instance 3b018901-74c5-4165-9944-187550602e1b could not be found. Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e96aab23-ad1d-4033-8810-9d70776c916b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Request method failure captured: Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b HTTP/1.1 Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeha-c6uiuuPA8C79UuMcsTyaozqrSUaLK66JryF0q8DuN1JdixUvG99ZjPsPrGKl_XPJu2oT3faRBPoBHuFCRYw3w1Xa0bYcDM-c8_Xy49TW6uQIRSCl8eF4lbHkKlGRr6dwzaidJVDZo2aA8EIES-QOq71MpdD0AvXjsMXZ4f31MA Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 1f01e21018a54220ba1e54c6b7bfc400 Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:10:14.567969 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:10:14.569858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1f01e21018a54220ba1e54c6b7bfc400", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:10:14.569858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:10:14.569858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 1f01e21018a54220ba1e54c6b7bfc400 Aug 24 09:10:14.569858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:10:14.569858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-TestVolumeBootPattern-1568297340-project Aug 24 09:10:14.569858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:10:14.569858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:10:14.569858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: c2c3752027f342a489e6eb9d3b540819 Aug 24 09:10:14.569858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-TestVolumeBootPattern-1568297340-project Aug 24 09:10:14.569858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:10:14.569858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance 3b018901-74c5-4165-9944-187550602e1b could not be found. Aug 24 09:10:14.569858 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': '3b018901-74c5-4165-9944-187550602e1b'} Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b018901-74c5-4165-9944-187550602e1b could not be found. Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:10:14.571039 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b018901-74c5-4165-9944-187550602e1b could not be found. Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b018901-74c5-4165-9944-187550602e1b could not be found. Aug 24 09:10:14.572759 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:10:14.574358 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e96aab23-ad1d-4033-8810-9d70776c916b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Returning 404 to user: Instance 3b018901-74c5-4165-9944-187550602e1b could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:10:14.574358 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e96aab23-ad1d-4033-8810-9d70776c916b tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b" status: 404 len: 111 microversion: 2.1 time: 0.033429 Aug 24 09:10:14.574358 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 697/1411] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:14 2022] GET /compute/v2.1/servers/3b018901-74c5-4165-9944-187550602e1b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:10:15.130168 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-60be9fc1-109a-42fe-a907-90f8e77f0bc1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:15.130701 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-60be9fc1-109a-42fe-a907-90f8e77f0bc1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:15.137239 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60be9fc1-109a-42fe-a907-90f8e77f0bc1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:15.137759 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60be9fc1-109a-42fe-a907-90f8e77f0bc1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:15.138152 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60be9fc1-109a-42fe-a907-90f8e77f0bc1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:15.138853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60be9fc1-109a-42fe-a907-90f8e77f0bc1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:15.139299 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60be9fc1-109a-42fe-a907-90f8e77f0bc1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:15.139721 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-60be9fc1-109a-42fe-a907-90f8e77f0bc1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:15.157301 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-60be9fc1-109a-42fe-a907-90f8e77f0bc1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] HTTP exception thrown: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-60be9fc1-109a-42fe-a907-90f8e77f0bc1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Request method failure captured: Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: DELETE /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c HTTP/1.1 Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBeha-c6uiuuPA8C79UuMcsTyaozqrSUaLK66JryF0q8DuN1JdixUvG99ZjPsPrGKl_XPJu2oT3faRBPoBHuFCRYw3w1Xa0bYcDM-c8_Xy49TW6uQIRSCl8eF4lbHkKlGRr6dwzaidJVDZo2aA8EIES-QOq71MpdD0AvXjsMXZ4f31MA Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: 1f01e21018a54220ba1e54c6b7bfc400 Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:10:15.158985 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:10:15.160833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1f01e21018a54220ba1e54c6b7bfc400", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:10:15.160833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:10:15.160833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: 1f01e21018a54220ba1e54c6b7bfc400 Aug 24 09:10:15.160833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:10:15.160833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-TestVolumeBootPattern-1568297340-project Aug 24 09:10:15.160833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:10:15.160833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:10:15.160833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: c2c3752027f342a489e6eb9d3b540819 Aug 24 09:10:15.160833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-TestVolumeBootPattern-1568297340-project Aug 24 09:10:15.160833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:10:15.160833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:10:15.160833 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '20347088-35b8-4cfe-8457-8ca131fcfa2c'} Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:10:15.161708 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:10:15.163620 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:10:15.165233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-60be9fc1-109a-42fe-a907-90f8e77f0bc1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Returning 404 to user: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:10:15.165233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-60be9fc1-109a-42fe-a907-90f8e77f0bc1 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "DELETE /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 404 len: 111 microversion: 2.1 time: 0.034087 Aug 24 09:10:15.165233 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 715/1412] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:10:15 2022] DELETE /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:10:15.169411 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5e58cf6e-ecf5-454f-aa7c-17c0ad28f173 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:15.170174 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5e58cf6e-ecf5-454f-aa7c-17c0ad28f173 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] [instance: 20347088-35b8-4cfe-8457-8ca131fcfa2c] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:15.176161 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e58cf6e-ecf5-454f-aa7c-17c0ad28f173 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:15.176670 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e58cf6e-ecf5-454f-aa7c-17c0ad28f173 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:15.177192 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e58cf6e-ecf5-454f-aa7c-17c0ad28f173 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:15.177876 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e58cf6e-ecf5-454f-aa7c-17c0ad28f173 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:15.178319 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e58cf6e-ecf5-454f-aa7c-17c0ad28f173 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:15.178731 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5e58cf6e-ecf5-454f-aa7c-17c0ad28f173 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:15.192909 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.wsgi [None req-5e58cf6e-ecf5-454f-aa7c-17c0ad28f173 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] HTTP exception thrown: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5e58cf6e-ecf5-454f-aa7c-17c0ad28f173 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Request method failure captured: Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: request: GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c HTTP/1.1 Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept: application/json Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Accept-Encoding: identity Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Connection: close Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Length: 0 Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Content-Type: application/json Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Host: 10.222.0.55 Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Openstack-System-Scope: None Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: User-Agent: python-urllib3/1.26.11 Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Auth-Token: gAAAAABjBeha-c6uiuuPA8C79UuMcsTyaozqrSUaLK66JryF0q8DuN1JdixUvG99ZjPsPrGKl_XPJu2oT3faRBPoBHuFCRYw3w1Xa0bYcDM-c8_Xy49TW6uQIRSCl8eF4lbHkKlGRr6dwzaidJVDZo2aA8EIES-QOq71MpdD0AvXjsMXZ4f31MA Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Id: None Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Domain-Name: None Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Identity-Status: Confirmed Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Is-Admin-Project: True Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Id: default Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Domain-Name: Default Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Id: 1f01e21018a54220ba1e54c6b7bfc400 Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Project-Name: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Role: member,reader Aug 24 09:10:15.195464 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Roles: member,reader Aug 24 09:10:15.197300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1f01e21018a54220ba1e54c6b7bfc400", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1f01e21018a54220ba1e54c6b7bfc400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:10:15.197300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:10:15.197300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Id: 1f01e21018a54220ba1e54c6b7bfc400 Aug 24 09:10:15.197300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-Tenant-Name: tempest-TestVolumeBootPattern-1568297340 Aug 24 09:10:15.197300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User: tempest-TestVolumeBootPattern-1568297340-project Aug 24 09:10:15.197300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Id: default Aug 24 09:10:15.197300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Domain-Name: Default Aug 24 09:10:15.197300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Id: c2c3752027f342a489e6eb9d3b540819 Aug 24 09:10:15.197300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: X-User-Name: tempest-TestVolumeBootPattern-1568297340-project Aug 24 09:10:15.197300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: method: > Aug 24 09:10:15.197300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: exception: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:10:15.197300 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: action_args: {'id': '20347088-35b8-4cfe-8457-8ca131fcfa2c'} Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:10:15.198943 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. Aug 24 09:10:15.200821 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR nova.api.openstack.wsgi Aug 24 09:10:15.202063 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5e58cf6e-ecf5-454f-aa7c-17c0ad28f173 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Returning 404 to user: Instance 20347088-35b8-4cfe-8457-8ca131fcfa2c could not be found. {{(pid=132985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:10:15.202063 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5e58cf6e-ecf5-454f-aa7c-17c0ad28f173 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c" status: 404 len: 111 microversion: 2.1 time: 0.030604 Aug 24 09:10:15.202063 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 698/1413] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:15 2022] GET /compute/v2.1/servers/20347088-35b8-4cfe-8457-8ca131fcfa2c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:10:15.366416 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d19002e1-5817-4da1-adac-2e8dc73ec4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:15.367082 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d19002e1-5817-4da1-adac-2e8dc73ec4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:15.374148 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d19002e1-5817-4da1-adac-2e8dc73ec4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:15.374624 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d19002e1-5817-4da1-adac-2e8dc73ec4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:15.375050 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d19002e1-5817-4da1-adac-2e8dc73ec4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:15.375813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d19002e1-5817-4da1-adac-2e8dc73ec4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:15.376259 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d19002e1-5817-4da1-adac-2e8dc73ec4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:15.376779 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d19002e1-5817-4da1-adac-2e8dc73ec4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:15.519564 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d19002e1-5817-4da1-adac-2e8dc73ec4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:15.524397 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:10:15.529228 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d19002e1-5817-4da1-adac-2e8dc73ec4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.166664 Aug 24 09:10:15.529897 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 716/1414] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:15 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:16.551152 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-f8e24451-c11c-471d-9df3-4bca467a988c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:16.551747 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-f8e24451-c11c-471d-9df3-4bca467a988c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:16.558907 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8e24451-c11c-471d-9df3-4bca467a988c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:16.559624 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8e24451-c11c-471d-9df3-4bca467a988c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:16.560232 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8e24451-c11c-471d-9df3-4bca467a988c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:16.561149 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8e24451-c11c-471d-9df3-4bca467a988c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:16.561780 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8e24451-c11c-471d-9df3-4bca467a988c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:16.562213 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-f8e24451-c11c-471d-9df3-4bca467a988c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:16.702742 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-f8e24451-c11c-471d-9df3-4bca467a988c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:16.710503 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-f8e24451-c11c-471d-9df3-4bca467a988c tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.163308 Aug 24 09:10:16.711046 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 699/1415] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:16 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:16.737413 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-627981d6-2576-4a5a-90f3-aa0568853242 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] Calling method '.version_select at 0x7f16b2aa0dc0>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:16.814340 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-627981d6-2576-4a5a-90f3-aa0568853242 tempest-TestVolumeBootPattern-1568297340 tempest-TestVolumeBootPattern-1568297340-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-320820006" status: 202 len: 0 microversion: 2.1 time: 0.086221 Aug 24 09:10:16.815017 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 717/1416] 10.222.0.55 () {58 vars in 1260 bytes} [Wed Aug 24 09:10:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-320820006 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:10:17.734580 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-5cba7af4-ad1e-48fb-9ad3-342fee889d97 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:17.735859 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-5cba7af4-ad1e-48fb-9ad3-342fee889d97 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:17.749127 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5cba7af4-ad1e-48fb-9ad3-342fee889d97 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:17.750199 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5cba7af4-ad1e-48fb-9ad3-342fee889d97 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:17.750740 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5cba7af4-ad1e-48fb-9ad3-342fee889d97 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:17.751776 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5cba7af4-ad1e-48fb-9ad3-342fee889d97 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:17.752329 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5cba7af4-ad1e-48fb-9ad3-342fee889d97 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:17.752895 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-5cba7af4-ad1e-48fb-9ad3-342fee889d97 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:17.915637 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-5cba7af4-ad1e-48fb-9ad3-342fee889d97 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:17.923736 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-5cba7af4-ad1e-48fb-9ad3-342fee889d97 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.196135 Aug 24 09:10:17.925029 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 700/1417] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:17 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:18.946370 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-92e32764-ef38-4b13-8a27-fecac09b030b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:18.947007 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-92e32764-ef38-4b13-8a27-fecac09b030b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:18.963927 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-92e32764-ef38-4b13-8a27-fecac09b030b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:18.966890 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-92e32764-ef38-4b13-8a27-fecac09b030b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:18.967383 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-92e32764-ef38-4b13-8a27-fecac09b030b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:18.968504 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-92e32764-ef38-4b13-8a27-fecac09b030b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:18.969020 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-92e32764-ef38-4b13-8a27-fecac09b030b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:18.970445 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-92e32764-ef38-4b13-8a27-fecac09b030b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:19.188377 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-5a1ec6bd-9608-4cf0-9535-554e4815fe2a req-c96e54aa-c0eb-4100-bd75-658f2e3da20f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d117b5-1850-4c20-9c32-177d76a0f5bb", "name": "network-vif-plugged", "status": "completed", "tag": "a316d1ef-63e0-44df-bde0-c53760d141f5"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:10:19.204108 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-92e32764-ef38-4b13-8a27-fecac09b030b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:19.210853 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-92e32764-ef38-4b13-8a27-fecac09b030b tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.268967 Aug 24 09:10:19.211866 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 718/1418] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:18 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:19.225217 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-5a1ec6bd-9608-4cf0-9535-554e4815fe2a req-c96e54aa-c0eb-4100-bd75-658f2e3da20f service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:19.225217 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-5a1ec6bd-9608-4cf0-9535-554e4815fe2a req-c96e54aa-c0eb-4100-bd75-658f2e3da20f service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:19.225217 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-5a1ec6bd-9608-4cf0-9535-554e4815fe2a req-c96e54aa-c0eb-4100-bd75-658f2e3da20f service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:19.228161 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-5a1ec6bd-9608-4cf0-9535-554e4815fe2a req-c96e54aa-c0eb-4100-bd75-658f2e3da20f service nova] Creating event network-vif-plugged:a316d1ef-63e0-44df-bde0-c53760d141f5 for instance 35d117b5-1850-4c20-9c32-177d76a0f5bb on hv-cinder-85221 Aug 24 09:10:19.234022 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-5a1ec6bd-9608-4cf0-9535-554e4815fe2a req-c96e54aa-c0eb-4100-bd75-658f2e3da20f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049474 Aug 24 09:10:19.234631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 701/1419] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:10:20.233423 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-7d5a804b-4ed9-4567-b9d8-0421580b0a1e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:20.235984 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-7d5a804b-4ed9-4567-b9d8-0421580b0a1e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:20.240292 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7d5a804b-4ed9-4567-b9d8-0421580b0a1e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:20.240813 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7d5a804b-4ed9-4567-b9d8-0421580b0a1e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:20.241245 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7d5a804b-4ed9-4567-b9d8-0421580b0a1e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:20.241955 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7d5a804b-4ed9-4567-b9d8-0421580b0a1e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:20.242399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7d5a804b-4ed9-4567-b9d8-0421580b0a1e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:20.242814 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-7d5a804b-4ed9-4567-b9d8-0421580b0a1e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:20.395988 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-7d5a804b-4ed9-4567-b9d8-0421580b0a1e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:20.405447 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-7d5a804b-4ed9-4567-b9d8-0421580b0a1e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.176006 Aug 24 09:10:20.432065 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 719/1420] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:20 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:21.428399 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-e534735d-f330-4787-9192-4fe43460827e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:21.430052 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-e534735d-f330-4787-9192-4fe43460827e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:21.437974 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e534735d-f330-4787-9192-4fe43460827e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:21.438583 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e534735d-f330-4787-9192-4fe43460827e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:21.439119 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e534735d-f330-4787-9192-4fe43460827e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:21.439918 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e534735d-f330-4787-9192-4fe43460827e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:21.440631 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e534735d-f330-4787-9192-4fe43460827e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:21.441244 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-e534735d-f330-4787-9192-4fe43460827e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:21.446914 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:10:21.653826 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-e534735d-f330-4787-9192-4fe43460827e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:21.668376 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-e534735d-f330-4787-9192-4fe43460827e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1563 microversion: 2.1 time: 0.244569 Aug 24 09:10:21.670378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 702/1421] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:21 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:12:11.895618 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR oslo.messaging._drivers.impl_rabbit [-] [872ba01f-8df2-47f7-af9c-ac687c02277e] AMQP server on 10.222.0.55:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 09:12:11.896634 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:12:11.897457 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG dbcounter [-] [132984] Writing DB stats nova_cell1:SELECT=12 {{(pid=132984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:12:11.897690 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eead65b0-8354-4012-9f92-afc8ca9c6ac7] AMQP server on 10.222.0.55:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 09:12:11.898596 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:12:11.899320 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG dbcounter [-] [132985] Writing DB stats nova_cell1:SELECT=4 {{(pid=132985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:12:11.902032 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-027b6295-7034-46d8-b17b-009555d5bf9e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:12:11.914586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-027b6295-7034-46d8-b17b-009555d5bf9e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:12:11.914586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-027b6295-7034-46d8-b17b-009555d5bf9e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:11.914586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-027b6295-7034-46d8-b17b-009555d5bf9e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:11.914586 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-027b6295-7034-46d8-b17b-009555d5bf9e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:11.915616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-027b6295-7034-46d8-b17b-009555d5bf9e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:11.915616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-027b6295-7034-46d8-b17b-009555d5bf9e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:11.915616 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-027b6295-7034-46d8-b17b-009555d5bf9e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:11.938171 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-027b6295-7034-46d8-b17b-009555d5bf9e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Going to try to terminate instance {{(pid=132984) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:12:12.038038 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-62fb70da-b73e-47f5-827b-ed4ccc039bf4 req-d27b4935-8332-43f7-9bc0-ebc8daf1f7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d117b5-1850-4c20-9c32-177d76a0f5bb", "tag": "a316d1ef-63e0-44df-bde0-c53760d141f5"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:12:12.049048 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-62fb70da-b73e-47f5-827b-ed4ccc039bf4 req-d27b4935-8332-43f7-9bc0-ebc8daf1f7a3 service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:12.049661 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-62fb70da-b73e-47f5-827b-ed4ccc039bf4 req-d27b4935-8332-43f7-9bc0-ebc8daf1f7a3 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:12.050086 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-62fb70da-b73e-47f5-827b-ed4ccc039bf4 req-d27b4935-8332-43f7-9bc0-ebc8daf1f7a3 service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:12.063063 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-62fb70da-b73e-47f5-827b-ed4ccc039bf4 req-d27b4935-8332-43f7-9bc0-ebc8daf1f7a3 service nova] Creating event network-changed:a316d1ef-63e0-44df-bde0-c53760d141f5 for instance 35d117b5-1850-4c20-9c32-177d76a0f5bb on hv-cinder-85221 Aug 24 09:12:12.068849 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-62fb70da-b73e-47f5-827b-ed4ccc039bf4 req-d27b4935-8332-43f7-9bc0-ebc8daf1f7a3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172723 Aug 24 09:12:12.069529 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 703/1422] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:12:12.212947 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-027b6295-7034-46d8-b17b-009555d5bf9e tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "DELETE /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 204 len: 0 microversion: 2.1 time: 0.319106 Aug 24 09:12:12.216331 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 720/1423] 10.222.0.55 () {58 vars in 1239 bytes} [Wed Aug 24 09:12:11 2022] DELETE /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:12:12.225847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-60d43e8b-95b7-40a6-baf3-30d5ad067d36 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:12:12.228271 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-60d43e8b-95b7-40a6-baf3-30d5ad067d36 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:12:12.234378 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-60d43e8b-95b7-40a6-baf3-30d5ad067d36 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:12.234898 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-60d43e8b-95b7-40a6-baf3-30d5ad067d36 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:12.235330 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-60d43e8b-95b7-40a6-baf3-30d5ad067d36 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:12.236026 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-60d43e8b-95b7-40a6-baf3-30d5ad067d36 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:12.236474 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-60d43e8b-95b7-40a6-baf3-30d5ad067d36 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:12.236938 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-60d43e8b-95b7-40a6-baf3-30d5ad067d36 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:12.430432 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-60d43e8b-95b7-40a6-baf3-30d5ad067d36 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:12:12.438205 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-60d43e8b-95b7-40a6-baf3-30d5ad067d36 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.217433 Aug 24 09:12:12.439136 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 704/1424] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:12:12 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:12:13.459964 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-b369c6cb-0eaf-4ffc-88ca-bba93dc569d9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:12:13.460618 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-b369c6cb-0eaf-4ffc-88ca-bba93dc569d9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:12:13.468308 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b369c6cb-0eaf-4ffc-88ca-bba93dc569d9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:13.468800 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b369c6cb-0eaf-4ffc-88ca-bba93dc569d9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:13.469238 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b369c6cb-0eaf-4ffc-88ca-bba93dc569d9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:13.469941 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b369c6cb-0eaf-4ffc-88ca-bba93dc569d9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:13.470389 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b369c6cb-0eaf-4ffc-88ca-bba93dc569d9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:13.470845 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-b369c6cb-0eaf-4ffc-88ca-bba93dc569d9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:13.491399 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO oslo.messaging._drivers.impl_rabbit [-] [872ba01f-8df2-47f7-af9c-ac687c02277e] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 46356. Aug 24 09:12:13.679660 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-b369c6cb-0eaf-4ffc-88ca-bba93dc569d9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:12:13.687501 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-b369c6cb-0eaf-4ffc-88ca-bba93dc569d9 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.231942 Aug 24 09:12:13.688076 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 721/1425] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:12:13 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:12:14.606865 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [req-d58172e7-8c55-4f2e-9e7d-277e9b4f0212 req-e52e1e4b-ca87-4e29-9c81-e1e18e496e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d117b5-1850-4c20-9c32-177d76a0f5bb", "name": "network-vif-deleted", "tag": "a316d1ef-63e0-44df-bde0-c53760d141f5"}]} {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:12:14.617642 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-d58172e7-8c55-4f2e-9e7d-277e9b4f0212 req-e52e1e4b-ca87-4e29-9c81-e1e18e496e5a service nova] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:14.622178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-d58172e7-8c55-4f2e-9e7d-277e9b4f0212 req-e52e1e4b-ca87-4e29-9c81-e1e18e496e5a service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:14.622178 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [req-d58172e7-8c55-4f2e-9e7d-277e9b4f0212 req-e52e1e4b-ca87-4e29-9c81-e1e18e496e5a service nova] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:14.631557 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.compute.server_external_events [req-d58172e7-8c55-4f2e-9e7d-277e9b4f0212 req-e52e1e4b-ca87-4e29-9c81-e1e18e496e5a service nova] Creating event network-vif-deleted:a316d1ef-63e0-44df-bde0-c53760d141f5 for instance 35d117b5-1850-4c20-9c32-177d76a0f5bb on hv-cinder-85221 Aug 24 09:12:14.635255 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO oslo.messaging._drivers.impl_rabbit [-] [eead65b0-8354-4012-9f92-afc8ca9c6ac7] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 46362. Aug 24 09:12:14.637455 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [req-d58172e7-8c55-4f2e-9e7d-277e9b4f0212 req-e52e1e4b-ca87-4e29-9c81-e1e18e496e5a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033885 Aug 24 09:12:14.638168 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 705/1426] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Aug 24 09:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:12:14.708268 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-d6df3d0c-3f0b-4079-bcec-6b9f96f0c177 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:12:14.708918 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-d6df3d0c-3f0b-4079-bcec-6b9f96f0c177 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:12:14.715323 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d6df3d0c-3f0b-4079-bcec-6b9f96f0c177 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:14.715807 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d6df3d0c-3f0b-4079-bcec-6b9f96f0c177 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:14.716277 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d6df3d0c-3f0b-4079-bcec-6b9f96f0c177 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:14.717005 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d6df3d0c-3f0b-4079-bcec-6b9f96f0c177 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:14.717463 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d6df3d0c-3f0b-4079-bcec-6b9f96f0c177 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:14.717938 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-d6df3d0c-3f0b-4079-bcec-6b9f96f0c177 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:14.784471 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.policy [None req-d6df3d0c-3f0b-4079-bcec-6b9f96f0c177 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132984) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:12:14.792481 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-d6df3d0c-3f0b-4079-bcec-6b9f96f0c177 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1383 microversion: 2.1 time: 0.088093 Aug 24 09:12:14.793913 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 722/1427] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:12:14 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1383 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:12:15.814778 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:12:15.815472 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.compute.api [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132985) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:12:15.822109 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:15.823254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:15.823254 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:15.823741 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:15.824226 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:15.825180 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:15.855955 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:15.856422 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:15.856879 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG oslo_concurrency.lockutils [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:15.857317 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.objects.instance [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lazy-loading 'fault' on Instance uuid 35d117b5-1850-4c20-9c32-177d76a0f5bb {{(pid=132985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:12:15.900609 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.policy [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0d3eebf714e8891c6a3eebf8d87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19c750fc9af412f93ff6369e4c57730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:12:15.908345 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-04c2258c-0df2-4eb2-a7e8-ddd2fe31d1dc tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 200 len: 1225 microversion: 2.1 time: 0.097832 Aug 24 09:12:15.908922 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 706/1428] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:12:15 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:12:16.929521 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3d44a833-4b69-43f8-b95c-eb807f18a4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '>' {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:12:16.930131 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.compute.api [None req-3d44a833-4b69-43f8-b95c-eb807f18a4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] [instance: 35d117b5-1850-4c20-9c32-177d76a0f5bb] Fetching instance by UUID {{(pid=132984) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:12:16.936568 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d44a833-4b69-43f8-b95c-eb807f18a4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:16.937059 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d44a833-4b69-43f8-b95c-eb807f18a4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:16.937486 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d44a833-4b69-43f8-b95c-eb807f18a4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:16.938159 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d44a833-4b69-43f8-b95c-eb807f18a4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Acquiring lock "d7d12875-14d7-416e-86d0-e7719092bb5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:16.938602 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d44a833-4b69-43f8-b95c-eb807f18a4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:16.939018 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG oslo_concurrency.lockutils [None req-3d44a833-4b69-43f8-b95c-eb807f18a4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Lock "d7d12875-14d7-416e-86d0-e7719092bb5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:16.952380 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.wsgi [None req-3d44a833-4b69-43f8-b95c-eb807f18a4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] HTTP exception thrown: Instance 35d117b5-1850-4c20-9c32-177d76a0f5bb could not be found. Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3d44a833-4b69-43f8-b95c-eb807f18a4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Request method failure captured: Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: request: GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb HTTP/1.1 Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept: application/json Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Accept-Encoding: identity Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Connection: close Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Length: 0 Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Content-Type: application/json Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Host: 10.222.0.55 Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Openstack-System-Scope: None Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: User-Agent: python-urllib3/1.26.11 Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Auth-Token: gAAAAABjBenpwx_WcJzGtZ3n4m06h4kfbvPPQJQVbXbPcbxwYNzcNeXNXIVJgp2t623D9giqE0f75PY-0pfrtbCCZom1r4IAdd1mZo2YzW2QbGwcAT0uJmpgG-fcr8gNA3LA_SHMw8WkoD2b7gVkiZ-XP_-BimcF4hWEPgCnIYvSj-KMAHBcY1M Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Id: None Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Domain-Name: None Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Identity-Status: Confirmed Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Is-Admin-Project: True Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Id: default Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Domain-Name: Default Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Id: e19c750fc9af412f93ff6369e4c57730 Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Project-Name: tempest-TestShelveInstance-163326354 Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Role: member,reader Aug 24 09:12:16.954089 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Roles: member,reader Aug 24 09:12:16.956003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e19c750fc9af412f93ff6369e4c57730"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e19c750fc9af412f93ff6369e4c57730", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e19c750fc9af412f93ff6369e4c57730"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e19c750fc9af412f93ff6369e4c57730"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}] Aug 24 09:12:16.956003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant: tempest-TestShelveInstance-163326354 Aug 24 09:12:16.956003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Id: e19c750fc9af412f93ff6369e4c57730 Aug 24 09:12:16.956003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-Tenant-Name: tempest-TestShelveInstance-163326354 Aug 24 09:12:16.956003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User: tempest-TestShelveInstance-163326354-project Aug 24 09:12:16.956003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Id: default Aug 24 09:12:16.956003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Domain-Name: Default Aug 24 09:12:16.956003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Id: faf0d3eebf714e8891c6a3eebf8d87a9 Aug 24 09:12:16.956003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: X-User-Name: tempest-TestShelveInstance-163326354-project Aug 24 09:12:16.956003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: method: > Aug 24 09:12:16.956003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: exception: Instance 35d117b5-1850-4c20-9c32-177d76a0f5bb could not be found. Aug 24 09:12:16.956003 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: action_args: {'id': '35d117b5-1850-4c20-9c32-177d76a0f5bb'} Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: {{(pid=132984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35d117b5-1850-4c20-9c32-177d76a0f5bb could not be found. Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:12:16.957138 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35d117b5-1850-4c20-9c32-177d76a0f5bb could not be found. Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35d117b5-1850-4c20-9c32-177d76a0f5bb could not be found. Aug 24 09:12:16.958873 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: ERROR nova.api.openstack.wsgi Aug 24 09:12:16.960440 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: DEBUG nova.api.openstack.wsgi [None req-3d44a833-4b69-43f8-b95c-eb807f18a4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Returning 404 to user: Instance 35d117b5-1850-4c20-9c32-177d76a0f5bb could not be found. {{(pid=132984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:12:16.960440 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO nova.api.openstack.requestlog [None req-3d44a833-4b69-43f8-b95c-eb807f18a4d8 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb" status: 404 len: 111 microversion: 2.1 time: 0.029833 Aug 24 09:12:16.960440 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: [pid: 132984|app: 0|req: 723/1429] 10.222.0.55 () {58 vars in 1236 bytes} [Wed Aug 24 09:12:16 2022] GET /compute/v2.1/servers/35d117b5-1850-4c20-9c32-177d76a0f5bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:12:17.228847 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: DEBUG nova.api.openstack.wsgi [None req-dd2d9c8e-e281-42cc-94a4-78ab47fd37a7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] Calling method '.version_select at 0x7f16ae4cd160>' {{(pid=132985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:12:17.298860 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO nova.api.openstack.requestlog [None req-dd2d9c8e-e281-42cc-94a4-78ab47fd37a7 tempest-TestShelveInstance-163326354 tempest-TestShelveInstance-163326354-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2051527144" status: 202 len: 0 microversion: 2.1 time: 0.074013 Aug 24 09:12:17.299438 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: [pid: 132985|app: 0|req: 707/1430] 10.222.0.55 () {58 vars in 1254 bytes} [Wed Aug 24 09:12:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2051527144 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 09:12:22.815643 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:12:22.816354 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Wed Aug 24 09:12:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:12:33.074063 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:12:33.074712 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Wed Aug 24 09:12:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:14:40.250066 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:14:40.250594 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Wed Aug 24 09:14:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:15:42.825184 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:15:42.825906 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Wed Aug 24 09:15:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:15:45.179213 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:15:45.179818 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Wed Aug 24 09:15:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:15:53.082472 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:15:53.083241 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Wed Aug 24 09:15:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:17:25.550473 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:17:25.551050 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Wed Aug 24 09:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:17:43.394298 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:17:43.394871 dv-cinder-852210-4-iscsi devstack@n-api.service[132984]: Wed Aug 24 09:17:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:18:00.258295 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:18:00.258896 dv-cinder-852210-4-iscsi devstack@n-api.service[132985]: Wed Aug 24 09:18:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!